Aug 05 15:27:34 devstack cinder-volume[77902]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 15:27:34 devstack cinder-volume[77902]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:27:34 devstack cinder-volume[77902]: we strongly recommend against using it for new projects. Aug 05 15:27:34 devstack cinder-volume[77902]: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:27:34 devstack cinder-volume[77902]: framework. For more detail see Aug 05 15:27:34 devstack cinder-volume[77902]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:27:34 devstack cinder-volume[77902]: import eventlet # noqa Aug 05 15:27:37 devstack cinder-volume[77902]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:27:37 devstack cinder-volume[77902]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:27:37 devstack cinder-volume[77902]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:27:38 devstack cinder-volume[77902]: INFO dbcounter [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Registered counter for database cinder Aug 05 15:27:38 devstack cinder-volume[77902]: DEBUG oslo_db.sqlalchemy.engines [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:27:39 devstack cinder-volume[77902]: DEBUG dbcounter [-] [77902] Writer thread running {{(pid=77902) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:27:39 devstack cinder-volume[77902]: INFO cinder.rpc [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 15:27:39 devstack cinder-volume[77902]: INFO cinder.rpc [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 15:27:39 devstack cinder-volume[77902]: DEBUG oslo_db.sqlalchemy.engines [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:27:39 devstack cinder-volume[77902]: INFO cinder.volume.manager [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Determined volume DB was empty at startup. Aug 05 15:27:39 devstack cinder-volume[77902]: DEBUG cinder.volume.manager [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77902) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 15:27:39 devstack cinder-volume[77902]: INFO cinder.volume.manager [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 15:27:39 devstack cinder-volume[77902]: WARNING stevedore.named [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:27:39 devstack cinder-volume[77902]: WARNING castellan.key_manager [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:27:39 devstack cinder-volume[77902]: WARNING cinder.keymgr.conf_key_mgr [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:27:39 devstack cinder-volume[77902]: DEBUG cinder.volume.drivers.lvm [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77902) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 05 15:27:39 devstack cinder-volume[77902]: DEBUG oslo_concurrency.processutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77902) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:39 devstack cinder-volume[77902]: DEBUG oslo_concurrency.processutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] CMD "cinder-rtstool verify" returned: 0 in 0.479s {{(pid=77902) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_db.sqlalchemy.engines [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:27:40 devstack cinder-volume[77902]: INFO cinder.rpc [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 05 15:27:40 devstack cinder-volume[77902]: INFO cinder.rpc [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 05 15:27:40 devstack cinder-volume[77902]: WARNING stevedore.named [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:27:40 devstack cinder-volume[77902]: WARNING castellan.key_manager [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:27:40 devstack cinder-volume[77902]: INFO cinder.volume.manager [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_db.sqlalchemy.engines [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:27:40 devstack cinder-volume[77902]: INFO oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Starting 1 workers Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Started child 78112 {{(pid=77902) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Full set of CONF: {{(pid=77902) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] ******************************************************************************** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Configuration options gathered from: {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] ================================================================================ {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] allow_availability_zone_fallback = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[78112]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] allow_compression_on_image_upload = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] allowed_direct_url_schemes = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] api_rate_limit = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] auth_strategy = keystone {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] az_cache_duration = 3600 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_availability_zone = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_host = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_stats_polling_interval = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backup_api_class = cinder.backup.api.API {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backup_name_template = backup-%s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backup_use_same_host = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backup_use_temp_snapshot = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] chap_password = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] chap_username = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_internal_tenant_project_id = e441134de8b54981b15c2b6c1743efd9 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_internal_tenant_user_id = 21e8c218785c46329bc42108c6579ae1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cloned_volume_same_az = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cluster = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] compression_format = gzip {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] compute_api_class = cinder.compute.nova.API {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] config_dir = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] config_source = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] control_exchange = openstack {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] debug = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] default_availability_zone = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] default_group_type = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] default_volume_type = lvmdriver-1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] disk_geometry = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] driver_client_cert = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] driver_client_cert_key = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] driver_data_namespace = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] driver_ssl_cert_path = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] driver_ssl_cert_verify = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] driver_use_ssl = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] enable_force_upload = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] enable_new_services = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] enable_unsupported_driver = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] enabled_backends = ['lvmdriver-1'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] enforce_multipath_for_image_xfer = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] filter_function = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_api_insecure = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_api_servers = ['http://192.168.122.44/image'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_api_ssl_compression = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_ca_certificates_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_catalog_info = image:glance:publicURL {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_num_retries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance_request_timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] goodness_function = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] graceful_shutdown_timeout = 5 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] group_api_class = cinder.group.api.API {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] host = devstack {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_compress_on_upload = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_conversion_address_space_limit = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_conversion_cpu_limit = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_conversion_disable = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_upload_use_cinder_backend = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_upload_use_internal_tenant = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_volume_cache_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_volume_cache_max_count = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] image_volume_cache_max_size_gb = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] init_host_max_objects_retrieval = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] instance_format = [instance: %(uuid)s] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] iscsi_target_flags = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] iscsi_write_cache = on {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] iser_helper = tgtadm {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] iser_ip_address = 192.168.122.44 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] iser_port = 3260 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_color = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_config_append = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_dir = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_options = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_rotate_interval = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_rotate_interval_type = days {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[78112]: INFO cinder.volume.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] log_rotation_type = none {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] max_age = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] max_logfile_count = 30 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] max_logfile_size_mb = 200 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] max_over_subscription_ratio = 20.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] message_reap_interval = 86400 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] message_ttl = 2592000 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] migration_create_volume_timeout_secs = 300 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] monkey_patch = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] monkey_patch_modules = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] my_ip = 192.168.122.44 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] no_snapshot_gb_quota = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] num_iser_scan_tries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] num_shell_tries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] num_volume_device_scan_tries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] nvmeof_conn_info_version = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] nvmet_ns_id = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] nvmet_port_id = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_max_limit = 1000 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_volume_ext_list = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_volume_listen = 0.0.0.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_volume_listen_port = 8776 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_volume_use_ssl = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] osapi_volume_workers = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] per_volume_size_limit = -1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] periodic_fuzzy_delay = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] periodic_interval = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] project_id_regex = [0-9a-f\-]+ {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] public_endpoint = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] publish_errors = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_backup_gigabytes = 1000 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_backups = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_gigabytes = 1000 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_groups = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_snapshots = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] quota_volumes = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] rate_limit_burst = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] rate_limit_except_level = CRITICAL {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] rate_limit_interval = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] reinit_driver_count = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] replication_device = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] report_discard_supported = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] report_interval = 120 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] reservation_clean_interval = 86400 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] reservation_expire = 86400 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] reserved_image_namespaces = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] reserved_percentage = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] rpc_response_timeout = 120 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] run_external_periodic_tasks = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] scst_target_driver = iscsi {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] scst_target_iqn_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_down_time = 720 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] shell_completion = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] snapshot_name_template = snapshot-%s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] snapshot_same_host = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] split_loggers = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] state_path = /opt/stack/data/cinder {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] storage_availability_zone = nova {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] storage_protocol = iSCSI {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] syslog_log_facility = LOG_USER {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] target_helper = lioadm {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] target_ip_address = 192.168.122.44 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] target_port = 3260 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] target_protocol = iscsi {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] target_secondary_ip_addresses = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] trace_flags = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] transfer_api_class = cinder.transfer.api.API {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] transport_url = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] until_refresh = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_chap_auth = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_default_quota_class = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_journal = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_json = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_multipath_for_image_xfer = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_stderr = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] use_syslog = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] verify_glance_signatures = enabled {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_api_class = cinder.volume.api.API {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_backend_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_clear = zero {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_clear_ionice = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_clear_size = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_copy_bps_limit = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_dd_blocksize = 1M {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_name_template = volume-%s {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_service_inithost_offload = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volume_usage_audit_period = month {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] zoning_mode = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_concurrency.disable_process_locking = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.auth_section = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.auth_type = password {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.auth_version = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.cache = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.delay_auth_decision = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.http_connect_timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.include_service_catalog = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.insecure = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.interface = public {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_password = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcache_username = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.region_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.service_token_roles_required = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.service_type = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.token_cache_time = 300 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.44/identity {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.backend = dogpile.cache.null {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.backend_argument = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.backend_expiration_time = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.config_prefix = cache.oslo {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.debug_cache_backend = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.enable_retry_client = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.enable_socket_keepalive = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.expiration_time = 600 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.hashclient_retry_attempts = 2 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_dead_retry = 300 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_pool_maxsize = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_sasl_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.password = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.proxies = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.redis_db = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.redis_sentinel_service_name = mymaster {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.redis_server = localhost:6379 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.retry_attempts = 2 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.retry_delay = 0.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.socket_keepalive_count = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.socket_keepalive_idle = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.socket_keepalive_interval = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.socket_timeout = 1.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.tls_allowed_ciphers = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.tls_cafile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.tls_certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.tls_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.tls_keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cache.username = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] coordination.backend_url = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.asyncio_connection = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.asyncio_slave_connection = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack sudo[78170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.backend = sqlalchemy {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.connection = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.connection_debug = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.connection_parameters = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.connection_recycle_time = 3600 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.connection_trace = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.db_inc_retry_interval = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack sudo[78170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.db_max_retries = 20 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.db_max_retry_interval = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.db_retry_interval = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.max_overflow = 50 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.max_pool_size = 5 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.max_retries = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.mysql_wsrep_sync_wait = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.pool_timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.retry_interval = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.slave_connection = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.sqlite_synchronous = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.synchronous_reader = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] database.use_db_reconnect = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.connection_string = messaging:// {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.es_doc_type = notification {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.es_scroll_size = 10000 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.es_scroll_time = 2m {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.filter_error_trace = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.hmac_keys = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.sentinel_service_name = mymaster {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.socket_timeout = 0.1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.trace_requests = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler.trace_sqlalchemy = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler_jaeger.process_tags = {} {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler_jaeger.service_name_prefix = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] profiler_otlp.service_name_prefix = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.enforce_new_defaults = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.policy_default_rule = default {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.policy_file = policy.yaml {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_policy.remote_timeout = 60.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.group = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.helper_command = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] privsep_osbrick.user = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.group = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.helper_command = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] cinder_sys_admin.user = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.auth_section = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.auth_type = password {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.cafile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.collect_timing = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.insecure = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.send_service_user_token = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.split_loggers = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] service_user.timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.auth_section = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.auth_type = password {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.collect_timing = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.insecure = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.region_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.split_loggers = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] glance.timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.backend_availability_zone = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.chap_password = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.chap_username = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.disk_geometry = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.driver_client_cert = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.driver_client_cert_key = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.driver_data_namespace = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.driver_use_ssl = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.enable_unsupported_driver = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.extra_capabilities = {} {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.filter_function = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.goodness_function = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.iscsi_target_flags = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.iscsi_write_cache = on {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.iser_helper = tgtadm {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.iser_ip_address = 192.168.122.44 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.iser_port = 3260 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.lvm_mirrors = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.lvm_share_target = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.lvm_type = auto {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.num_shell_tries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.nvmet_port_id = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.replication_device = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.report_discard_supported = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.reserved_percentage = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.scst_target_driver = iscsi {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.scst_target_iqn_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.storage_protocol = iSCSI {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.target_helper = tgtadm {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.target_ip_address = 192.168.122.44 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.target_port = 3260 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.target_protocol = iscsi {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.trace_flags = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.unique_fqdn_network = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.use_chap_auth = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_backend_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_clear = zero {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_clear_ionice = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_clear_size = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volume_group = cinder-volumes {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_reports.file_event_handler = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_reports.log_dir = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.backend_availability_zone = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.backend_host = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.chap_password = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.chap_username = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.chiscsi_conf = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.disk_geometry = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.driver_client_cert = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.driver_data_namespace = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.driver_use_ssl = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.extra_capabilities = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.filter_function = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.goodness_function = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.iser_helper = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.iser_ip_address = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.iser_port = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.iser_target_prefix = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.lvm_conf_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.lvm_mirrors = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.lvm_share_target = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.lvm_type = auto {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.num_shell_tries = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.nvmet_port_id = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.replication_device = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.report_discard_supported = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.reserved_percentage = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.scst_target_driver = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.storage_protocol = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.target_helper = lioadm {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.target_ip_address = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.target_port = 3260 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.target_protocol = iscsi {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.trace_flags = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.use_chap_auth = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_clear = zero {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_clear_size = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] lvmdriver-1.volumes_dir = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.ssl_version = {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_notifications.driver = [] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_notifications.retry = -1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] oslo_messaging_notifications.transport_url = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] key_manager.fixed_key = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.barbican_api_version = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.barbican_endpoint = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.barbican_endpoint_type = public {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.barbican_region_name = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.cafile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.collect_timing = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.insecure = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.number_of_retries = 60 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.retry_delay = 1 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.send_service_user_token = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.split_loggers = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.verify_ssl = True {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican.verify_ssl_path = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.auth_section = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.auth_type = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.cafile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.certfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.collect_timing = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.insecure = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.keyfile = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.split_loggers = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] barbican_service_user.timeout = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.approle_role_id = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.approle_secret_id = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.auth_method = approle {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.auth_path = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.kv_mountpoint = secret {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.kv_path = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.kv_version = 2 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.namespace = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.root_token_id = **** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.ssl_ca_crt_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.timeout = 60.0 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.token_file = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.token_role = None {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.use_ssl = False {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:27:40 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] ******************************************************************************** {{(pid=77902) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 15:27:40 devstack sudo[78170]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack sudo[78263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:40 devstack sudo[78263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:40 devstack sudo[78263]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.260s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:27:40 devstack cinder-volume[78112]: INFO cinder.brick.local_dev.lvm [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:40 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:40 devstack sudo[78360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:27:40 devstack sudo[78360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:41 devstack sudo[78360]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG cinder.brick.local_dev.lvm [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78112) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:41 devstack sudo[78445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:41 devstack sudo[78445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:41 devstack sudo[78445]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.503s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:41 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:41 devstack sudo[78635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:41 devstack sudo[78635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:42 devstack sudo[78635]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:42 devstack sudo[78663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 05 15:27:42 devstack sudo[78663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:42 devstack sudo[78663]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.329s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:42 devstack sudo[78747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:27:42 devstack sudo[78747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:42 devstack sudo[78747]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:42 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:42 devstack sudo[78750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:27:42 devstack sudo[78750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:43 devstack sudo[78750]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.349s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:43 devstack sudo[78796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:43 devstack sudo[78796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:43 devstack sudo[78796]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:43 devstack sudo[78843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:43 devstack sudo[78843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:43 devstack sudo[78843]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:43 devstack sudo[78847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:43 devstack sudo[78847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:43 devstack sudo[78847]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:43 devstack cinder-volume[78112]: INFO cinder.volume.drivers.lvm [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:43 devstack sudo[78851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:43 devstack sudo[78851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:44 devstack sudo[78851]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:44 devstack sudo[78860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:27:44 devstack sudo[78860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:44 devstack sudo[78860]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:44 devstack sudo[78863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:44 devstack sudo[78863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:44 devstack sudo[78863]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:44 devstack sudo[78866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:44 devstack sudo[78866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:45 devstack sudo[78866]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:45 devstack sudo[78869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:45 devstack sudo[78869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:45 devstack sudo[78869]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:45 devstack cinder-volume[78112]: INFO cinder.volume.driver [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Driver hasn't implemented _init_vendor_properties() Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG cinder.volume.driver [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78112) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_db.sqlalchemy.engines [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78112) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writer thread running {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG cinder.db.api [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Building query based on filter {{(pid=78112) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG cinder.image.image_utils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78112) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 15:27:45 devstack cinder-volume[78112]: INFO cinder.keymgr.migration [None req-9eac8211-2f0e-4bca-8451-23d188e80ec1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:45 devstack sudo[78875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:27:45 devstack sudo[78875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:45 devstack sudo[78875]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:45 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:45 devstack sudo[78878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:45 devstack sudo[78878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:46 devstack sudo[78878]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:46 devstack sudo[78883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:46 devstack sudo[78883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:46 devstack sudo[78883]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:46 devstack sudo[78886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:46 devstack sudo[78886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:46 devstack sudo[78886]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG cinder.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Notifying Schedulers of capabilities ... {{(pid=78112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:27:46 devstack cinder-volume[78112]: INFO cinder.volume.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Driver initialization completed successfully. Aug 05 15:27:46 devstack cinder-volume[78112]: INFO cinder.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Initiating service 2 cleanup Aug 05 15:27:46 devstack cinder-volume[78112]: INFO cinder.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Service 2 cleanup completed. Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG cinder.service [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Creating RPC server for service cinder-volume {{(pid=78112) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG cinder.service [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78112) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 15:27:46 devstack cinder-volume[78112]: INFO cinder.volume.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:27:46 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:46 devstack sudo[78889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:27:46 devstack sudo[78889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:47 devstack sudo[78889]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:47 devstack sudo[78892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:47 devstack sudo[78892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:47 devstack sudo[78892]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:47 devstack sudo[78895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:27:47 devstack sudo[78895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:47 devstack sudo[78895]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:27:47 devstack sudo[78903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:27:47 devstack sudo[78903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:27:47 devstack sudo[78903]: pam_unix(sudo:session): session closed for user root Aug 05 15:27:47 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:27:48 devstack cinder-volume[78112]: INFO cinder.volume.manager [None req-cd2942e9-614d-4937-a86f-117edc94f834 None None] Driver post RPC initialization completed successfully. Aug 05 15:27:50 devstack cinder-volume[77902]: DEBUG dbcounter [-] [77902] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77902) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:27:56 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writing DB stats cinder:SELECT=3 {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:27:57 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_service.periodic_task [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78112) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:28:43 devstack sudo[80875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:28:43 devstack sudo[80875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:28:43 devstack sudo[80875]: pam_unix(sudo:session): session closed for user root Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:28:43 devstack sudo[80878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:28:43 devstack sudo[80878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:28:43 devstack sudo[80878]: pam_unix(sudo:session): session closed for user root Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:28:43 devstack sudo[80881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:28:43 devstack sudo[80881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:28:43 devstack sudo[80881]: pam_unix(sudo:session): session closed for user root Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:28:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:28:43 devstack sudo[80884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:28:43 devstack sudo[80884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:28:44 devstack sudo[80884]: pam_unix(sudo:session): session closed for user root Aug 05 15:28:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:28:44 devstack cinder-volume[78112]: DEBUG cinder.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Notifying Schedulers of capabilities ... {{(pid=78112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:28:44 devstack cinder-volume[78112]: DEBUG oslo_service.periodic_task [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running periodic task VolumeManager._thread_info {{(pid=78112) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:28:44 devstack cinder-volume[78112]: DEBUG cinder.volume.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] thread count: 6 {{(pid=78112) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:28:44 devstack cinder-volume[78112]: DEBUG cinder.volume.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] thread info: [<_MainThread(MainThread, started 128439600480384)>, , , , , ] {{(pid=78112) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_service.periodic_task [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78112) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:29:43 devstack sudo[84179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:29:43 devstack sudo[84179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:29:43 devstack sudo[84179]: pam_unix(sudo:session): session closed for user root Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:29:43 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:29:43 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:29:43 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:29:43 devstack sudo[84189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:29:43 devstack sudo[84189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:29:43 devstack sudo[84189]: pam_unix(sudo:session): session closed for user root Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:29:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:29:43 devstack sudo[84193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:29:43 devstack sudo[84193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:29:44 devstack sudo[84193]: pam_unix(sudo:session): session closed for user root Aug 05 15:29:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:29:44 devstack cinder-volume[78112]: DEBUG cinder.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Notifying Schedulers of capabilities ... {{(pid=78112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:29:58 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writing DB stats cinder:SELECT=1 {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:29:58 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writing DB stats cinder:UPDATE=1 {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_service.periodic_task [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78112) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:30:43 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:30:43 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:30:43 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:30:43 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:30:43 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:30:43 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:30:43 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:30:43 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:30:43 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:30:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:30:43 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:30:43 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:30:44 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Aug 05 15:30:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:30:44 devstack cinder-volume[78112]: DEBUG cinder.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Notifying Schedulers of capabilities ... {{(pid=78112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:30:44 devstack cinder-volume[78112]: DEBUG oslo_service.periodic_task [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running periodic task VolumeManager._thread_info {{(pid=78112) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:30:44 devstack cinder-volume[78112]: DEBUG cinder.volume.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] thread count: 6 {{(pid=78112) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:30:44 devstack cinder-volume[78112]: DEBUG cinder.volume.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] thread info: [<_MainThread(MainThread, started 128439600480384)>, , , , , ] {{(pid=78112) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_service.periodic_task [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78112) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG cinder.volume.drivers.lvm [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Updating volume stats {{(pid=78112) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:31:43 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 05 15:31:43 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:31:43 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:31:43 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:31:43 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:31:43 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:31:43 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 05 15:31:43 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:31:43 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:31:43 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:31:43 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 05 15:31:43 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:31:44 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Aug 05 15:31:44 devstack cinder-volume[78112]: DEBUG oslo_concurrency.processutils [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78112) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:31:44 devstack cinder-volume[78112]: DEBUG cinder.manager [None req-d929b344-a17e-4c1b-8e23-ad1b039c4d91 None None] Notifying Schedulers of capabilities ... {{(pid=78112) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:31:58 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writing DB stats cinder:SELECT=1 {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:31:58 devstack cinder-volume[78112]: DEBUG dbcounter [-] [78112] Writing DB stats cinder:UPDATE=1 {{(pid=78112) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:32:08 devstack cinder-volume[77902]: INFO oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Caught SIGTERM, stopping children Aug 05 15:32:08 devstack cinder-volume[77902]: DEBUG oslo_concurrency.lockutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Acquiring lock "singleton_lock" {{(pid=77902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:32:08 devstack cinder-volume[77902]: DEBUG oslo_concurrency.lockutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Acquired lock "singleton_lock" {{(pid=77902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:32:08 devstack cinder-volume[77902]: DEBUG oslo_concurrency.lockutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Releasing lock "singleton_lock" {{(pid=77902) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:32:08 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Stop services. {{(pid=77902) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 15:32:08 devstack cinder-volume[77902]: DEBUG oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Killing children. {{(pid=77902) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 15:32:08 devstack cinder-volume[77902]: INFO oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Waiting on 1 children to exit Aug 05 15:32:11 devstack cinder-volume[78112]: DEBUG oslo_concurrency.lockutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Acquiring lock "singleton_lock" {{(pid=78112) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:32:11 devstack cinder-volume[78112]: DEBUG oslo_concurrency.lockutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Acquired lock "singleton_lock" {{(pid=78112) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:32:11 devstack cinder-volume[78112]: DEBUG oslo_concurrency.lockutils [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Releasing lock "singleton_lock" {{(pid=78112) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:32:11 devstack cinder-volume[78112]: WARNING amqp [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:32:11 devstack cinder-volume[78112]: WARNING amqp [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:32:11 devstack cinder-volume[77902]: INFO oslo_service.backend._eventlet.service [None req-cc0534e0-c52f-4207-8782-6b55ea2636af None None] Child 78112 exited with status 0 Aug 05 15:32:12 devstack cinder-volume[88184]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 15:32:12 devstack cinder-volume[88184]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:32:12 devstack cinder-volume[88184]: we strongly recommend against using it for new projects. Aug 05 15:32:12 devstack cinder-volume[88184]: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:32:12 devstack cinder-volume[88184]: framework. For more detail see Aug 05 15:32:12 devstack cinder-volume[88184]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:32:12 devstack cinder-volume[88184]: import eventlet # noqa Aug 05 15:32:14 devstack cinder-volume[88184]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:32:14 devstack cinder-volume[88184]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:32:14 devstack cinder-volume[88184]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:32:15 devstack cinder-volume[88184]: INFO dbcounter [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Registered counter for database cinder Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_db.sqlalchemy.engines [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG dbcounter [-] [88184] Writer thread running {{(pid=88184) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:32:15 devstack cinder-volume[88184]: INFO cinder.rpc [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 15:32:15 devstack cinder-volume[88184]: INFO cinder.rpc [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_db.sqlalchemy.engines [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:15 devstack cinder-volume[88184]: INFO cinder.volume.manager [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Determined volume DB was empty at startup. Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG cinder.volume.manager [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88184) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 15:32:15 devstack cinder-volume[88184]: INFO cinder.volume.manager [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 05 15:32:15 devstack cinder-volume[88184]: WARNING stevedore.named [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:32:15 devstack cinder-volume[88184]: WARNING castellan.key_manager [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:32:15 devstack cinder-volume[88184]: WARNING cinder.keymgr.conf_key_mgr [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:32:15 devstack cinder-volume[88184]: INFO cinder.volume.manager [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_db.sqlalchemy.engines [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88184) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:15 devstack cinder-volume[88184]: INFO oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Starting 1 workers Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Started child 88405 {{(pid=88184) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Full set of CONF: {{(pid=88184) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] ******************************************************************************** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Configuration options gathered from: {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] ================================================================================ {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] allow_availability_zone_fallback = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] allow_compression_on_image_upload = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] allowed_direct_url_schemes = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] api_rate_limit = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] auth_strategy = keystone {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_availability_zone = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_host = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_stats_polling_interval = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backup_api_class = cinder.backup.api.API {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backup_name_template = backup-%s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backup_use_same_host = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backup_use_temp_snapshot = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] chap_password = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] chap_username = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_internal_tenant_project_id = e441134de8b54981b15c2b6c1743efd9 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_internal_tenant_user_id = 21e8c218785c46329bc42108c6579ae1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cluster = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] compression_format = gzip {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88405]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] compute_api_class = cinder.compute.nova.API {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] config_dir = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] config_source = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] control_exchange = openstack {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] debug = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] default_availability_zone = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] default_group_type = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] default_volume_type = QuobyteHD {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] disk_geometry = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] driver_client_cert = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] driver_client_cert_key = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] driver_data_namespace = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] driver_ssl_cert_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] driver_ssl_cert_verify = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] driver_use_ssl = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] enable_new_services = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] enable_unsupported_driver = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] enabled_backends = ['QuobyteHD'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] enforce_multipath_for_image_xfer = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] filter_function = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_api_insecure = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_api_servers = ['http://192.168.122.44/image'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_api_ssl_compression = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_ca_certificates_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_catalog_info = image:glance:publicURL {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_num_retries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance_request_timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] goodness_function = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] graceful_shutdown_timeout = 5 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] group_api_class = cinder.group.api.API {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] host = devstack {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_compress_on_upload = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_conversion_address_space_limit = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_conversion_cpu_limit = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_conversion_disable = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_upload_use_cinder_backend = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_upload_use_internal_tenant = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_volume_cache_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_volume_cache_max_count = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] image_volume_cache_max_size_gb = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] init_host_max_objects_retrieval = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] instance_format = [instance: %(uuid)s] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] iscsi_target_flags = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] iscsi_write_cache = on {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] iser_helper = tgtadm {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] iser_ip_address = 192.168.122.44 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] iser_port = 3260 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_color = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_config_append = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_dir = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_options = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_rotate_interval = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_rotate_interval_type = days {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] log_rotation_type = none {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] max_age = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] max_logfile_count = 30 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] max_logfile_size_mb = 200 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] max_over_subscription_ratio = 20.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] message_reap_interval = 86400 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] message_ttl = 2592000 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] migration_create_volume_timeout_secs = 300 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] monkey_patch = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] monkey_patch_modules = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] my_ip = 192.168.122.44 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] no_snapshot_gb_quota = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] num_iser_scan_tries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] num_shell_tries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] num_volume_device_scan_tries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] nvmeof_conn_info_version = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] nvmet_ns_id = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] nvmet_port_id = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_max_limit = 1000 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_volume_ext_list = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_volume_listen_port = 8776 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_volume_use_ssl = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] osapi_volume_workers = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] per_volume_size_limit = -1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] periodic_fuzzy_delay = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] periodic_interval = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] public_endpoint = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] publish_errors = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_backup_gigabytes = 1000 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_backups = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_gigabytes = 1000 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_groups = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_snapshots = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] quota_volumes = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] rate_limit_burst = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] rate_limit_except_level = CRITICAL {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] rate_limit_interval = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] reinit_driver_count = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] replication_device = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] report_discard_supported = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] report_interval = 120 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] reservation_clean_interval = 86400 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] reservation_expire = 86400 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] reserved_image_namespaces = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] reserved_percentage = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] rpc_response_timeout = 120 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] run_external_periodic_tasks = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] scst_target_driver = iscsi {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] scst_target_iqn_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_down_time = 720 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] shell_completion = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] snapshot_name_template = snapshot-%s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] split_loggers = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] state_path = /opt/stack/data/cinder {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] storage_availability_zone = nova {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] storage_protocol = iSCSI {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] syslog_log_facility = LOG_USER {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] target_helper = lioadm {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] target_ip_address = 192.168.122.44 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] target_port = 3260 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] target_protocol = iscsi {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] target_secondary_ip_addresses = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] trace_flags = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] transport_url = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] until_refresh = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_chap_auth = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_default_quota_class = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_journal = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_json = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_multipath_for_image_xfer = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_stderr = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] use_syslog = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] verify_glance_signatures = enabled {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_api_class = cinder.volume.api.API {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_backend_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_clear = zero {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_clear_ionice = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_clear_size = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_copy_bps_limit = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_dd_blocksize = 1M {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_name_template = volume-%s {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_service_inithost_offload = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volume_usage_audit_period = month {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:15 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] zoning_mode = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_concurrency.disable_process_locking = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.auth_section = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.auth_type = password {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.auth_version = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.cache = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.include_service_catalog = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.insecure = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.interface = public {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_password = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcache_username = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88405]: INFO cinder.volume.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Starting volume driver QuobyteDriver (1.2) Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.remotefs [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88405) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.region_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.service_type = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.44/identity {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.backend = dogpile.cache.null {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.backend_argument = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.backend_expiration_time = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.config_prefix = cache.oslo {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.debug_cache_backend = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.enable_retry_client = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.enable_socket_keepalive = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.expiration_time = 600 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.hashclient_retry_attempts = 2 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_dead_retry = 300 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_pool_maxsize = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_sasl_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.password = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.proxies = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.redis_db = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.redis_server = localhost:6379 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.retry_attempts = 2 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.retry_delay = 0.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.socket_keepalive_count = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.socket_keepalive_idle = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.socket_keepalive_interval = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.socket_timeout = 1.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.tls_allowed_ciphers = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.tls_cafile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.tls_certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.tls_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.tls_keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cache.username = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] coordination.backend_url = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.asyncio_connection = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.asyncio_slave_connection = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.backend = sqlalchemy {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.connection = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.connection_debug = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.connection_parameters = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.connection_recycle_time = 3600 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.connection_trace = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.db_inc_retry_interval = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.db_max_retries = 20 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.db_max_retry_interval = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.db_retry_interval = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.max_overflow = 50 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.max_pool_size = 5 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.max_retries = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.mysql_wsrep_sync_wait = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.pool_timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.retry_interval = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.slave_connection = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.sqlite_synchronous = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.synchronous_reader = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] database.use_db_reconnect = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.connection_string = messaging:// {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.es_doc_type = notification {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.es_scroll_size = 10000 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.es_scroll_time = 2m {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.filter_error_trace = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.hmac_keys = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.sentinel_service_name = mymaster {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.socket_timeout = 0.1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.trace_requests = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler.trace_sqlalchemy = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler_jaeger.process_tags = {} {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler_jaeger.service_name_prefix = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] profiler_otlp.service_name_prefix = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.enforce_new_defaults = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.policy_default_rule = default {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.policy_file = policy.yaml {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.group = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.helper_command = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] privsep_osbrick.user = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.group = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.helper_command = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] cinder_sys_admin.user = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.auth_section = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.auth_type = password {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.cafile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.collect_timing = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.insecure = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.send_service_user_token = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.split_loggers = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] service_user.timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.auth_section = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.auth_type = password {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.collect_timing = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.insecure = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.region_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.split_loggers = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] glance.timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.backend_availability_zone = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.chap_password = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.chap_username = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.disk_geometry = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.driver_client_cert = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.driver_client_cert_key = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.driver_data_namespace = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.driver_use_ssl = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.extra_capabilities = {} {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.filter_function = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.goodness_function = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.iscsi_target_flags = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.iscsi_write_cache = on {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.iser_helper = tgtadm {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.iser_ip_address = 192.168.122.44 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.iser_port = 3260 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_host = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_login = admin {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_mount_options = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_password = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_private_key = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_share_path = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.num_shell_tries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.quobyte_volume_url = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.replication_device = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.report_discard_supported = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.reserved_percentage = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.target_helper = tgtadm {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.target_ip_address = 192.168.122.44 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.target_port = 3260 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.target_protocol = iscsi {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.trace_flags = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.unique_fqdn_network = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.use_chap_auth = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_backend_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_clear = zero {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_clear_ionice = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_clear_size = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_reports.file_event_handler = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_reports.log_dir = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.backend_availability_zone = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.backend_host = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.chap_password = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.chap_username = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.chiscsi_conf = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.disk_geometry = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.driver_client_cert = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.driver_data_namespace = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.driver_use_ssl = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.extra_capabilities = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.filter_function = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.goodness_function = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.iser_helper = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.iser_ip_address = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.iser_port = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.iser_target_prefix = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_host = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_login = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_mount_options = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_password = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_private_key = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_share_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_ssh_port = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.num_shell_tries = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.nvmet_port_id = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.replication_device = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.report_discard_supported = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.reserved_percentage = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.scst_target_driver = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.storage_protocol = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.target_helper = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.target_ip_address = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.target_port = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.target_prefix = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.target_protocol = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.trace_flags = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.use_chap_auth = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_clear = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_clear_size = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] QuobyteHD.volumes_dir = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_notifications.driver = [] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_notifications.retry = -1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] key_manager.fixed_key = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.barbican_api_version = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.barbican_endpoint = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.barbican_endpoint_type = public {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.barbican_region_name = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.cafile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88405) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 15:32:16 devstack cinder-volume[88405]: WARNING cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88405]: WARNING cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.collect_timing = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.insecure = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.number_of_retries = 60 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.retry_delay = 1 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.send_service_user_token = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Running cmd (subprocess): mount.quobyte {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.split_loggers = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.verify_ssl = True {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican.verify_ssl_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.auth_section = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.auth_type = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.cafile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.certfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.collect_timing = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.insecure = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.keyfile = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.split_loggers = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] barbican_service_user.timeout = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.approle_role_id = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.approle_secret_id = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.auth_method = approle {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.auth_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.kv_mountpoint = secret {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.kv_path = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.kv_version = 2 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.namespace = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.root_token_id = **** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.ssl_ca_crt_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.timeout = 60.0 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.token_file = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.token_role = None {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.use_ssl = False {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:16 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] ******************************************************************************** {{(pid=88184) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 15:32:16 devstack quobyte-client[88410]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 15:32:16 devstack quobyte-client[88410]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] CMD "mount.quobyte" returned: 1 in 0.070s {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:32:16 devstack cinder-volume[88405]: INFO cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 ... Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad -c /etc/quobyte/client-cinder.cfg {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:16 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad -c /etc/quobyte/client-cinder.cfg Aug 05 15:32:16 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:16 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.371s {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:16 devstack cinder-volume[88405]: INFO cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 succeeded Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.380s {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:16 devstack sudo[88480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:32:16 devstack sudo[88480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:16 devstack sudo[88480]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.247s {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:16 devstack cinder-volume[88405]: INFO cinder.volume.driver [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Driver hasn't implemented _init_vendor_properties() Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.driver [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940155029297, 'free_capacity_gb': 1775.6940155029297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88405) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_db.sqlalchemy.engines [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88405) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG dbcounter [-] [88405] Writer thread running {{(pid=88405) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.db.api [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Building query based on filter {{(pid=88405) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.image.image_utils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88405) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 15:32:16 devstack cinder-volume[88405]: INFO cinder.keymgr.migration [None req-0035e96e-b6d3-4182-9546-5dc6a9d5d073 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:32:16 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:16 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:32:16 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:17 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.229s {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG cinder.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Notifying Schedulers of capabilities ... {{(pid=88405) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:32:17 devstack cinder-volume[88405]: INFO cinder.volume.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Driver initialization completed successfully. Aug 05 15:32:17 devstack cinder-volume[88405]: INFO cinder.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Initiating service 3 cleanup Aug 05 15:32:17 devstack cinder-volume[88405]: INFO cinder.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Service 3 cleanup completed. Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG cinder.service [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Creating RPC server for service cinder-volume {{(pid=88405) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG cinder.service [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88405) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 15:32:17 devstack cinder-volume[88405]: INFO cinder.volume.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88405) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG cinder.volume.drivers.quobyte [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88405) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88405) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:17 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:32:17 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:17 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:17 devstack cinder-volume[88405]: DEBUG oslo_concurrency.processutils [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.240s {{(pid=88405) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:17 devstack cinder-volume[88405]: INFO cinder.volume.manager [None req-fde8bfcd-4b1a-484e-97e7-d7aa6764d58a None None] Driver post RPC initialization completed successfully. Aug 05 15:32:21 devstack cinder-volume[88184]: INFO oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Caught SIGTERM, stopping children Aug 05 15:32:21 devstack cinder-volume[88184]: DEBUG oslo_concurrency.lockutils [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Acquiring lock "singleton_lock" {{(pid=88184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:32:21 devstack cinder-volume[88184]: DEBUG oslo_concurrency.lockutils [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Acquired lock "singleton_lock" {{(pid=88184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:32:21 devstack cinder-volume[88184]: DEBUG oslo_concurrency.lockutils [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Releasing lock "singleton_lock" {{(pid=88184) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:32:21 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Stop services. {{(pid=88184) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 05 15:32:21 devstack cinder-volume[88184]: DEBUG oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Killing children. {{(pid=88184) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 05 15:32:21 devstack cinder-volume[88184]: INFO oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Waiting on 1 children to exit Aug 05 15:32:25 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Acquiring lock "singleton_lock" {{(pid=88405) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:32:25 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Acquired lock "singleton_lock" {{(pid=88405) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:32:25 devstack cinder-volume[88405]: DEBUG oslo_concurrency.lockutils [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Releasing lock "singleton_lock" {{(pid=88405) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:32:25 devstack cinder-volume[88405]: WARNING amqp [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:32:25 devstack cinder-volume[88405]: WARNING amqp [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 05 15:32:25 devstack cinder-volume[88184]: INFO oslo_service.backend._eventlet.service [None req-25e39ea2-fab7-4344-9259-b744982017e0 None None] Child 88405 exited with status 0 Aug 05 15:32:26 devstack cinder-volume[88693]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 05 15:32:26 devstack cinder-volume[88693]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:32:26 devstack cinder-volume[88693]: we strongly recommend against using it for new projects. Aug 05 15:32:26 devstack cinder-volume[88693]: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:32:26 devstack cinder-volume[88693]: framework. For more detail see Aug 05 15:32:26 devstack cinder-volume[88693]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:32:26 devstack cinder-volume[88693]: import eventlet # noqa Aug 05 15:32:28 devstack cinder-volume[88693]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 05 15:32:28 devstack cinder-volume[88693]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 05 15:32:28 devstack cinder-volume[88693]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88693) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 05 15:32:29 devstack cinder-volume[88693]: INFO dbcounter [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Registered counter for database cinder Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_db.sqlalchemy.engines [None req-5874feff-3fa4-48ed-9585-698282004090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG dbcounter [-] [88693] Writer thread running {{(pid=88693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:32:29 devstack cinder-volume[88693]: INFO cinder.rpc [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 05 15:32:29 devstack cinder-volume[88693]: INFO cinder.rpc [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_db.sqlalchemy.engines [None req-5874feff-3fa4-48ed-9585-698282004090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:29 devstack cinder-volume[88693]: INFO cinder.volume.manager [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Determined volume DB was empty at startup. Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG cinder.volume.manager [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88693) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 05 15:32:29 devstack cinder-volume[88693]: WARNING stevedore.named [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 05 15:32:29 devstack cinder-volume[88693]: WARNING castellan.key_manager [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:32:29 devstack cinder-volume[88693]: WARNING cinder.keymgr.conf_key_mgr [None req-5874feff-3fa4-48ed-9585-698282004090 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 05 15:32:29 devstack cinder-volume[88693]: INFO cinder.volume.manager [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_db.sqlalchemy.engines [None req-5874feff-3fa4-48ed-9585-698282004090 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88693) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:29 devstack cinder-volume[88693]: INFO oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Starting 1 workers Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Started child 88999 {{(pid=88693) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Full set of CONF: {{(pid=88693) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] ******************************************************************************** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] Configuration options gathered from: {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] ================================================================================ {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] allow_availability_zone_fallback = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88999]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] allow_compression_on_image_upload = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] allowed_direct_url_schemes = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] api_rate_limit = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] auth_strategy = keystone {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_availability_zone = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_host = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_stats_polling_interval = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backup_api_class = cinder.backup.api.API {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backup_name_template = backup-%s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backup_use_same_host = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backup_use_temp_snapshot = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] chap_password = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] chap_username = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_internal_tenant_project_id = e441134de8b54981b15c2b6c1743efd9 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_internal_tenant_user_id = 21e8c218785c46329bc42108c6579ae1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cluster = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] compression_format = gzip {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] compute_api_class = cinder.compute.nova.API {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] config_dir = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] config_source = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] control_exchange = openstack {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] debug = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] default_availability_zone = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] default_group_type = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] default_volume_type = QuobyteHD {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] disk_geometry = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] driver_client_cert = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] driver_client_cert_key = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] driver_data_namespace = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] driver_ssl_cert_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] driver_ssl_cert_verify = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] driver_use_ssl = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] enable_new_services = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] enable_unsupported_driver = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] enabled_backends = ['QuobyteHD'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] enforce_multipath_for_image_xfer = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] filter_function = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_api_insecure = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_api_servers = ['http://192.168.122.44/image'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_api_ssl_compression = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_ca_certificates_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_catalog_info = image:glance:publicURL {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_num_retries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance_request_timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] goodness_function = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] graceful_shutdown_timeout = 5 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] group_api_class = cinder.group.api.API {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] host = devstack {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_compress_on_upload = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_conversion_address_space_limit = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_conversion_cpu_limit = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_conversion_disable = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_upload_use_cinder_backend = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_upload_use_internal_tenant = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_volume_cache_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_volume_cache_max_count = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] image_volume_cache_max_size_gb = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] init_host_max_objects_retrieval = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] instance_format = [instance: %(uuid)s] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] iscsi_target_flags = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] iscsi_write_cache = on {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] iser_helper = tgtadm {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] iser_ip_address = 192.168.122.44 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] iser_port = 3260 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_color = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_config_append = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_dir = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_options = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_rotate_interval = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_rotate_interval_type = days {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] log_rotation_type = none {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] max_age = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] max_logfile_count = 30 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] max_logfile_size_mb = 200 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] max_over_subscription_ratio = 20.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] message_reap_interval = 86400 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] message_ttl = 2592000 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] migration_create_volume_timeout_secs = 300 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] monkey_patch = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] monkey_patch_modules = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] my_ip = 192.168.122.44 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] no_snapshot_gb_quota = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] num_iser_scan_tries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] num_shell_tries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] num_volume_device_scan_tries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] nvmeof_conn_info_version = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] nvmet_ns_id = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] nvmet_port_id = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_max_limit = 1000 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_volume_ext_list = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Starting volume driver QuobyteDriver (1.2) Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88999) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_volume_listen_port = 8776 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_volume_use_ssl = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] osapi_volume_workers = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] per_volume_size_limit = -1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] periodic_fuzzy_delay = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] periodic_interval = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] public_endpoint = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] publish_errors = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_backup_gigabytes = 1000 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_backups = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_gigabytes = 1000 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_groups = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_snapshots = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] quota_volumes = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] rate_limit_burst = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] rate_limit_except_level = CRITICAL {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] rate_limit_interval = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] reinit_driver_count = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] replication_device = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] report_discard_supported = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] report_interval = 120 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] reservation_clean_interval = 86400 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] reservation_expire = 86400 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] reserved_image_namespaces = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] reserved_percentage = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] rpc_response_timeout = 120 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] run_external_periodic_tasks = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] scst_target_driver = iscsi {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] scst_target_iqn_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_down_time = 720 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] shell_completion = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] snapshot_name_template = snapshot-%s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] split_loggers = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] state_path = /opt/stack/data/cinder {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] storage_availability_zone = nova {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] storage_protocol = iSCSI {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] syslog_log_facility = LOG_USER {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] target_helper = lioadm {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] target_ip_address = 192.168.122.44 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] target_port = 3260 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] target_protocol = iscsi {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] target_secondary_ip_addresses = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] trace_flags = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] transport_url = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] until_refresh = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_chap_auth = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_default_quota_class = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_journal = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_json = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_multipath_for_image_xfer = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_stderr = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] use_syslog = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] verify_glance_signatures = enabled {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_api_class = cinder.volume.api.API {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_backend_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_clear = zero {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_clear_ionice = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_clear_size = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:29 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_copy_bps_limit = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_dd_blocksize = 1M {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_name_template = volume-%s {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_service_inithost_offload = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volume_usage_audit_period = month {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] zoning_mode = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_concurrency.disable_process_locking = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.auth_section = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.auth_type = password {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.auth_version = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.cache = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.include_service_catalog = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.insecure = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.interface = public {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_password = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcache_username = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.region_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.service_type = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.44/identity {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.backend = dogpile.cache.null {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.backend_argument = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.backend_expiration_time = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.config_prefix = cache.oslo {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.debug_cache_backend = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.enable_retry_client = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.enable_socket_keepalive = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.expiration_time = 600 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.hashclient_retry_attempts = 2 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_dead_retry = 300 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_pool_maxsize = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_sasl_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.password = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.proxies = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.redis_db = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.redis_server = localhost:6379 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.retry_attempts = 2 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.retry_delay = 0.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.socket_keepalive_count = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.socket_keepalive_idle = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.socket_keepalive_interval = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.socket_timeout = 1.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.tls_allowed_ciphers = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.tls_cafile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.tls_certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.tls_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.tls_keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cache.username = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] coordination.backend_url = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.asyncio_connection = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.asyncio_slave_connection = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.backend = sqlalchemy {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.connection = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.connection_debug = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.connection_parameters = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.connection_recycle_time = 3600 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.connection_trace = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.db_inc_retry_interval = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.db_max_retries = 20 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.db_max_retry_interval = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.db_retry_interval = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.max_overflow = 50 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.max_pool_size = 5 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.max_retries = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.mysql_wsrep_sync_wait = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.pool_timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.retry_interval = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.slave_connection = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.sqlite_synchronous = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.synchronous_reader = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] database.use_db_reconnect = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.connection_string = messaging:// {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.es_doc_type = notification {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.es_scroll_size = 10000 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.es_scroll_time = 2m {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.filter_error_trace = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.hmac_keys = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.sentinel_service_name = mymaster {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.socket_timeout = 0.1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.trace_requests = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler.trace_sqlalchemy = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler_jaeger.process_tags = {} {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler_jaeger.service_name_prefix = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] profiler_otlp.service_name_prefix = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.enforce_new_defaults = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.policy_default_rule = default {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.policy_file = policy.yaml {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.group = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.helper_command = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] privsep_osbrick.user = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.group = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.helper_command = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] cinder_sys_admin.user = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.auth_section = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.auth_type = password {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.cafile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.collect_timing = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.insecure = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.send_service_user_token = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.split_loggers = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] service_user.timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.auth_section = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.auth_type = password {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.collect_timing = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.insecure = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.region_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.split_loggers = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] glance.timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.backend_availability_zone = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.chap_password = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.chap_username = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.disk_geometry = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.driver_client_cert = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.driver_client_cert_key = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.driver_data_namespace = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.driver_use_ssl = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.extra_capabilities = {} {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.filter_function = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.goodness_function = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.iscsi_target_flags = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.iscsi_write_cache = on {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.iser_helper = tgtadm {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.iser_ip_address = 192.168.122.44 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.iser_port = 3260 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_host = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_login = admin {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_mount_options = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_password = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_private_key = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_share_path = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88999) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.num_shell_tries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Running cmd (subprocess): mount.quobyte {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.quobyte_volume_url = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.replication_device = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.report_discard_supported = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.reserved_percentage = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.target_helper = tgtadm {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.target_ip_address = 192.168.122.44 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.target_port = 3260 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.target_protocol = iscsi {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.trace_flags = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.unique_fqdn_network = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.use_chap_auth = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_backend_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_clear = zero {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_clear_ionice = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_clear_size = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_reports.file_event_handler = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_reports.log_dir = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.backend_availability_zone = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.backend_host = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.chap_password = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.chap_username = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.chiscsi_conf = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.disk_geometry = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.driver_client_cert = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.driver_data_namespace = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.driver_use_ssl = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.extra_capabilities = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.filter_function = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.goodness_function = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.iser_helper = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.iser_ip_address = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.iser_port = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.iser_target_prefix = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_host = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_login = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_mount_options = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_password = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_private_key = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_share_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_ssh_port = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.num_shell_tries = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.nvmet_port_id = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.replication_device = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.report_discard_supported = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.reserved_percentage = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.scst_target_driver = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.storage_protocol = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.target_helper = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.target_ip_address = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.target_port = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.target_prefix = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.target_protocol = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.trace_flags = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.use_chap_auth = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_clear = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_clear_size = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] QuobyteHD.volumes_dir = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack quobyte-client[89000]: Reading configuration file: /etc/quobyte/client.cfg Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_notifications.driver = [] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_notifications.retry = -1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack quobyte-client[89000]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] key_manager.fixed_key = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.barbican_api_version = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.barbican_endpoint = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.barbican_endpoint_type = public {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.barbican_region_name = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.cafile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.collect_timing = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.insecure = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.number_of_retries = 60 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.retry_delay = 1 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.send_service_user_token = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.split_loggers = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.verify_ssl = True {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican.verify_ssl_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.auth_section = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.auth_type = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.cafile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.certfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.collect_timing = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.insecure = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.keyfile = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.split_loggers = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] barbican_service_user.timeout = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.approle_role_id = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.approle_secret_id = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.auth_method = approle {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.auth_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.kv_mountpoint = secret {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.kv_path = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.kv_version = 2 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.namespace = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.root_token_id = **** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.ssl_ca_crt_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.timeout = 60.0 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.token_file = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.token_role = None {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.use_ssl = False {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 05 15:32:30 devstack cinder-volume[88693]: DEBUG oslo_service.backend._eventlet.service [None req-5874feff-3fa4-48ed-9585-698282004090 None None] ******************************************************************************** {{(pid=88693) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 05 15:32:30 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:32:30 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:30 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.231s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:30 devstack cinder-volume[88999]: INFO cinder.volume.driver [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Driver hasn't implemented _init_vendor_properties() Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.driver [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940155029297, 'free_capacity_gb': 1775.6940155029297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88999) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_db.sqlalchemy.engines [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88999) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writer thread running {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.db.api [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Building query based on filter {{(pid=88999) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88999) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:30 devstack cinder-volume[88999]: INFO cinder.keymgr.migration [None req-9e048215-1b5a-455e-9857-db53ccac72d3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 05 15:32:30 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:32:30 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:30 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.224s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:32:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Driver initialization completed successfully. Aug 05 15:32:30 devstack cinder-volume[88999]: INFO cinder.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Initiating service 3 cleanup Aug 05 15:32:30 devstack cinder-volume[88999]: INFO cinder.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Service 3 cleanup completed. Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.service [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Creating RPC server for service cinder-volume {{(pid=88999) start /opt/stack/cinder/cinder/service.py:231}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.service [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88999) start /opt/stack/cinder/cinder/service.py:237}} Aug 05 15:32:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:32:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:32:30 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:32:30 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:32:31 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Aug 05 15:32:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.231s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:32:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-67f0c2a2-8d18-4ca7-993f-73345d114cde None None] Driver post RPC initialization completed successfully. Aug 05 15:32:39 devstack cinder-volume[88693]: DEBUG dbcounter [-] [88693] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88693) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:32:40 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:32:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:33:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:33:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 6 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:33:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Flow 'volume_create_manager' (16d693c0-da56-4740-abd3-a1fb937e6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa927f5c-f5ae-49e8-a754-5adbd529abab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa927f5c-f5ae-49e8-a754-5adbd529abab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-578525556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a493ac01-98d3-4193-947e-488210b27008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5269a91b44f05ba68b258c50dd607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:33:50Z,use_quota=True,user_id='2bfb35f0e8524e2e84166baf70ad2e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12478e47-e839-45d7-b683-7b8571bd450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12478e47-e839-45d7-b683-7b8571bd450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5760d9-903b-403b-ab3d-391405e7a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af5760d9-903b-403b-ab3d-391405e7a137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a493ac01-98d3-4193-947e-488210b27008', 'volume_name': 'volume-a493ac01-98d3-4193-947e-488210b27008', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a372e68-52f0-4938-84f6-994b144d4e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a372e68-52f0-4938-84f6-994b144d4e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f32781-1970-4f0d-854c-3e5175144fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:51 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Volume a493ac01-98d3-4193-947e-488210b27008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a493ac01-98d3-4193-947e-488210b27008', 'volume_size': 1} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:33:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-578525556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a493ac01-98d3-4193-947e-488210b27008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08b5269a91b44f05ba68b258c50dd607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:33:50Z,use_quota=True,user_id='2bfb35f0e8524e2e84166baf70ad2e72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Creating volume a493ac01-98d3-4193-947e-488210b27008 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:33:51 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:33:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:33:51 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 1073741824 Aug 05 15:33:51 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:33:52 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Aug 05 15:33:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 1073741824" returned: 0 in 1.721s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:33:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:33:52 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 Aug 05 15:33:52 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Flow 'volume_create_manager' (de21f821-db95-4123-ba87-e12ae46afb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b05deba-5540-4b7f-bede-5cc0fad8086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b05deba-5540-4b7f-bede-5cc0fad8086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1516096550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2164a41d-d9fa-494c-ac50-eacbed86c5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd436230eb74004bdb943e370ac7cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:33:53Z,use_quota=True,user_id='927e9f533cd14b3580afd3f2d9fc3676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b269e8d3-2e40-4cbf-b0ca-a77d30a1b526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b269e8d3-2e40-4cbf-b0ca-a77d30a1b526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f6e953-5b94-465e-a26f-e074508b1119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f6e953-5b94-465e-a26f-e074508b1119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2164a41d-d9fa-494c-ac50-eacbed86c5e2', 'volume_name': 'volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28a8e79-5a29-476f-ab54-52d5f8a41a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28a8e79-5a29-476f-ab54-52d5f8a41a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e542aa-8f03-4f49-9e58-1cbd4c751328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Volume 2164a41d-d9fa-494c-ac50-eacbed86c5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2', 'volume_size': 1} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:33:53 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008" returned: 0 in 0.695s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] <== create_volume: return (2571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.575s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.027s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1516096550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2164a41d-d9fa-494c-ac50-eacbed86c5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd436230eb74004bdb943e370ac7cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:33:53Z,use_quota=True,user_id='927e9f533cd14b3580afd3f2d9fc3676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Creating volume 2164a41d-d9fa-494c-ac50-eacbed86c5e2 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:33:53 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f32781-1970-4f0d-854c-3e5175144fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a493ac01-98d3-4193-947e-488210b27008', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbe2bb2-5bf8-4efd-b92e-c42b68d6eae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:53 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 1073741824 Aug 05 15:33:53 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:33:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Volume volume-a493ac01-98d3-4193-947e-488210b27008 (a493ac01-98d3-4193-947e-488210b27008): created successfully Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbe2bb2-5bf8-4efd-b92e-c42b68d6eae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Flow 'volume_create_manager' (16d693c0-da56-4740-abd3-a1fb937e6363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:33:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-127f2b13-cc9c-49f5-80a9-587be698769b tempest-DeleteServersTestJSON-718239261 None] Created volume successfully. Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Flow 'volume_create_manager' (f7547338-d1c2-4de3-93ac-44e9d5dd9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67f0a8a-2581-4787-ac81-9322de1ef9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67f0a8a-2581-4787-ac81-9322de1ef9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-137593976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f6d75e-637a-42a1-b383-9b4b4ff120c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c208d1f8978d400ab4909930453e2012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:33:55Z,use_quota=True,user_id='04b0eb762a434ec1b1a06456b7e6e499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20190ca-100a-4952-ab1a-cde9835af008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:54 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20190ca-100a-4952-ab1a-cde9835af008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a01bbc1-5e13-4c4c-8315-8fb0c9211379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a01bbc1-5e13-4c4c-8315-8fb0c9211379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f6d75e-637a-42a1-b383-9b4b4ff120c3', 'volume_name': 'volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bca413-a725-4965-a221-223e72803023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9bca413-a725-4965-a221-223e72803023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1dcffa-ed8a-4ac2-8ee8-9623cbcffece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:54 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Volume d6f6d75e-637a-42a1-b383-9b4b4ff120c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3', 'volume_size': 1} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 1073741824" returned: 0 in 1.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:33:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:33:54 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 Aug 05 15:33:54 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:33:55 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2" returned: 0 in 0.555s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-137593976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f6d75e-637a-42a1-b383-9b4b4ff120c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c208d1f8978d400ab4909930453e2012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:33:55Z,use_quota=True,user_id='04b0eb762a434ec1b1a06456b7e6e499',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Creating volume d6f6d75e-637a-42a1-b383-9b4b4ff120c3 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:33:55 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:33:55 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 1073741824 Aug 05 15:33:55 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e542aa-8f03-4f49-9e58-1cbd4c751328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f419ad-ba98-44bd-ad74-73d2cf68c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:55 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Volume volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 (2164a41d-d9fa-494c-ac50-eacbed86c5e2): created successfully Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f419ad-ba98-44bd-ad74-73d2cf68c426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Flow 'volume_create_manager' (de21f821-db95-4123-ba87-e12ae46afb67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:33:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ee498861-2909-4c04-8aee-b0989769c233 tempest-ServerRescueNegativeTestJSON-891122713 None] Created volume successfully. Aug 05 15:33:56 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Aug 05 15:33:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 1073741824" returned: 0 in 0.767s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:33:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:33:56 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 Aug 05 15:33:56 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:33:57 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3" returned: 0 in 0.665s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1dcffa-ed8a-4ac2-8ee8-9623cbcffece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a73c74-2d5a-40bc-8c34-4cbb5614b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:33:57 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Volume volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 (d6f6d75e-637a-42a1-b383-9b4b4ff120c3): created successfully Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a73c74-2d5a-40bc-8c34-4cbb5614b106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:33:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Flow 'volume_create_manager' (f7547338-d1c2-4de3-93ac-44e9d5dd9a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:33:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8533ee30-3c95-45dc-aa2c-2e45aa1bd4fa tempest-VolumesAdminNegativeTest-1915195825 None] Created volume successfully. Aug 05 15:33:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Acquiring lock "cinder-d6f6d75e-637a-42a1-b383-9b4b4ff120c3-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:33:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Lock "cinder-d6f6d75e-637a-42a1-b383-9b4b4ff120c3-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:33:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Acquiring lock "cinder-quobyte-d6f6d75e-637a-42a1-b383-9b4b4ff120c3" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:33:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Lock "cinder-quobyte-d6f6d75e-637a-42a1-b383-9b4b4ff120c3" acquired by "delete_volume" :: waited 0.051s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:33:59 devstack cinder-volume[88999]: INFO oslo.privsep.daemon [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp049iqdob/privsep.sock'] Aug 05 15:33:59 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp049iqdob/privsep.sock Aug 05 15:33:59 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: Aug 05 15:34:01 devstack cinder-volume[88999]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 05 15:34:02 devstack cinder-volume[88999]: WARNING py.warnings [req-8d753f9c-96e2-46da-9331-ec0f94d7f938 req-9df14909-502b-4f77-b3f9-bb1c06594242 tempest-DeleteServersTestJSON-718239261 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 05 15:34:02 devstack cinder-volume[88999]: .first() Aug 05 15:34:02 devstack cinder-volume[88999]: Aug 05 15:34:02 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:02 devstack cinder-volume[88999]: INFO oslo.privsep.daemon [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Spawned new privsep daemon via rootwrap Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Accepted privsep connection to /tmp/tmp049iqdob/privsep.sock {{(pid=88999) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 05 15:34:02 devstack cinder-volume[88999]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 05 15:34:02 devstack cinder-volume[88999]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 05 15:34:02 devstack cinder-volume[88999]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 05 15:34:02 devstack cinder-volume[88999]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90342 Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[97df82f0-bf57-4fcb-a075-195d1701c5fc]: (2,) {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-8d753f9c-96e2-46da-9331-ec0f94d7f938 req-9df14909-502b-4f77-b3f9-bb1c06594242 tempest-DeleteServersTestJSON-718239261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-8d753f9c-96e2-46da-9331-ec0f94d7f938 req-9df14909-502b-4f77-b3f9-bb1c06594242 tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92b21e3-411e-4b73-a889-640763010ad5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-8d753f9c-96e2-46da-9331-ec0f94d7f938 req-9df14909-502b-4f77-b3f9-bb1c06594242 tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.128s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-8d753f9c-96e2-46da-9331-ec0f94d7f938 req-9df14909-502b-4f77-b3f9-bb1c06594242 tempest-DeleteServersTestJSON-718239261 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-a493ac01-98d3-4193-947e-488210b27008', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fab586d-d445-48a3-a4e8-61392e556577', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:34:02 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 Aug 05 15:34:02 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:02 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-8d753f9c-96e2-46da-9331-ec0f94d7f938 req-9df14909-502b-4f77-b3f9-bb1c06594242 tempest-DeleteServersTestJSON-718239261 None] attachment_update completed successfully. Aug 05 15:34:03 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3" returned: 0 in 1.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:03 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3 Aug 05 15:34:03 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:04 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d6f6d75e-637a-42a1-b383-9b4b4ff120c3" returned: 0 in 0.697s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Lock "cinder-quobyte-d6f6d75e-637a-42a1-b383-9b4b4ff120c3" released by "delete_volume" :: held 5.243s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:34:04 devstack cinder-volume[88999]: WARNING cinder.quota [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:34:04 devstack cinder-volume[88999]: WARNING cinder.quota [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Created reservations ['b091bfdc-b00e-42ef-96f5-8d7ac88053ef', 'e501a907-9c63-4e7e-a6bc-d66ab45aa032', '82088724-520c-44fa-9642-0b0e04c2437e', '2d718d9a-2e1b-4064-af1e-2e4f7406b292'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:04 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:34:04 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:05 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.849s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:05 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:34:05 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Deleted volume successfully. Aug 05 15:34:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-159df5a7-04e4-492f-89a4-8a39751817c5 tempest-VolumesAdminNegativeTest-1915195825 None] Lock "cinder-d6f6d75e-637a-42a1-b383-9b4b4ff120c3-delete_volume" released by "delete_volume" :: held 6.952s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:10 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:34:10 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:10 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.748s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 8 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:34:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:34:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-9f9c26ab-1424-46cc-b5e6-c8bdcb5ced52 req-0c481aa0-ef5e-42f9-9eb6-1a0c83f8bcdf tempest-DeleteServersTestJSON-718239261 None] Terminate volume connection completed successfully. Aug 05 15:34:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-9f9c26ab-1424-46cc-b5e6-c8bdcb5ced52 req-0c481aa0-ef5e-42f9-9eb6-1a0c83f8bcdf tempest-DeleteServersTestJSON-718239261 None] Deleting attachment 0fab586d-d445-48a3-a4e8-61392e556577. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:34:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Acquiring lock "cinder-a493ac01-98d3-4193-947e-488210b27008-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:34:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Lock "cinder-a493ac01-98d3-4193-947e-488210b27008-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:34:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Acquiring lock "cinder-quobyte-a493ac01-98d3-4193-947e-488210b27008" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:34:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Lock "cinder-quobyte-a493ac01-98d3-4193-947e-488210b27008" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:34:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a439a8-b2e3-428f-93a8-cbc116be927c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:34:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:13 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 Aug 05 15:34:13 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:14 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008" returned: 0 in 0.728s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:14 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008 Aug 05 15:34:14 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:14 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a493ac01-98d3-4193-947e-488210b27008" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Lock "cinder-quobyte-a493ac01-98d3-4193-947e-488210b27008" released by "delete_volume" :: held 1.141s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Created reservations ['174d3a40-5854-43af-b099-4912b74d6112', 'bd9791c9-6cd4-47aa-b5e9-d081ee38e4a5', '742b87e6-86c0-4f4d-bfc1-31679873ae22', '50a21b21-1ba8-420c-8733-730dcbb65b60'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:14 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:34:14 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:15 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.285s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:15 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:34:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Deleted volume successfully. Aug 05 15:34:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce596bb0-92b2-495f-b104-cf7dac783b36 tempest-DeleteServersTestJSON-718239261 None] Lock "cinder-a493ac01-98d3-4193-947e-488210b27008-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Acquiring lock "cinder-2164a41d-d9fa-494c-ac50-eacbed86c5e2-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "cinder-2164a41d-d9fa-494c-ac50-eacbed86c5e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Acquiring lock "cinder-quobyte-2164a41d-d9fa-494c-ac50-eacbed86c5e2" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "cinder-quobyte-2164a41d-d9fa-494c-ac50-eacbed86c5e2" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[29873847-50a9-4579-825d-2a0a85077a3a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:21 devstack sudo[91028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 Aug 05 15:34:21 devstack sudo[91028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:21 devstack sudo[91028]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2" returned: 0 in 0.568s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:21 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2 Aug 05 15:34:21 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:22 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2164a41d-d9fa-494c-ac50-eacbed86c5e2" returned: 0 in 0.469s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "cinder-quobyte-2164a41d-d9fa-494c-ac50-eacbed86c5e2" released by "delete_volume" :: held 1.144s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Created reservations ['1eca2843-3a71-4b37-91b7-56ae407462c5', '2b8a0dca-41a0-4b50-bac4-02090e992187', '29b2cf64-4a4c-42c9-a76d-91d302a5d740', '8d4ba58a-b14a-4f08-989a-932768587097'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:22 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:34:22 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:23 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.467s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:23 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:34:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Deleted volume successfully. Aug 05 15:34:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4f7dc700-ed78-4c07-9ebc-9a1ddd289420 tempest-ServerRescueNegativeTestJSON-891122713 None] Lock "cinder-2164a41d-d9fa-494c-ac50-eacbed86c5e2-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:34:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=31,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=8 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:34:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=27,cinder:UPDATE=43,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Flow 'volume_create_manager' (190a2cdf-7ea8-475d-a44d-53779c9a6dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1695df-5fbf-4784-b726-d32575b08025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1695df-5fbf-4784-b726-d32575b08025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1005127081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a0e89d-e7de-429c-aa95-c89e70d104a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6522f23c0da04fea8c0f3f70e1d5304c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:34:56Z,use_quota=True,user_id='d0719341c429496ab5c11451de43792e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add0e36-81e3-4e65-ab35-2249fe9314c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add0e36-81e3-4e65-ab35-2249fe9314c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0992be2-c2df-4aa3-9667-d9aca57ddc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0992be2-c2df-4aa3-9667-d9aca57ddc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a0e89d-e7de-429c-aa95-c89e70d104a4', 'volume_name': 'volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7882eb96-af55-46ff-9a90-d311e6f600a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7882eb96-af55-46ff-9a90-d311e6f600a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c24d880-a6cc-4f35-a212-e0794f89d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:34:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Volume c8a0e89d-e7de-429c-aa95-c89e70d104a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4', 'volume_size': 1} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1005127081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a0e89d-e7de-429c-aa95-c89e70d104a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6522f23c0da04fea8c0f3f70e1d5304c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:34:56Z,use_quota=True,user_id='d0719341c429496ab5c11451de43792e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Creating volume c8a0e89d-e7de-429c-aa95-c89e70d104a4 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:34:56 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:56 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 1073741824 Aug 05 15:34:56 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:56 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 1073741824" returned: 0 in 0.499s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:34:56 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 Aug 05 15:34:56 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:34:57 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4" returned: 0 in 0.283s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c24d880-a6cc-4f35-a212-e0794f89d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a648223-7282-47cf-9cfa-e04a7e6de9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:34:57 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Volume volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 (c8a0e89d-e7de-429c-aa95-c89e70d104a4): created successfully Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a648223-7282-47cf-9cfa-e04a7e6de9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:34:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Flow 'volume_create_manager' (190a2cdf-7ea8-475d-a44d-53779c9a6dab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:34:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d148183d-3a1e-45f4-8f93-6dab405c1ad4 tempest-TaggedAttachmentsTest-1327224326 None] Created volume successfully. Aug 05 15:35:07 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:35:07 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:10 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:35:10 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:10 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.766s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Flow 'volume_create_manager' (65383089-945b-432c-b9e2-117ae2e3634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea36b0b-04e0-46f3-a662-13b20495dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea36b0b-04e0-46f3-a662-13b20495dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1002476912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c86d4e-c470-4d0d-be97-bc390a92dc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b008e7db92ac4755a7dd2b59c5ba0796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:35:39Z,use_quota=True,user_id='9f83a01570184a0382ff180422dfb315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b87fe7e-34b5-4a7b-b1a8-6b3a2bc0ab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b87fe7e-34b5-4a7b-b1a8-6b3a2bc0ab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ceb1b2-b774-4de5-952e-f16e624ee396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ceb1b2-b774-4de5-952e-f16e624ee396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29c86d4e-c470-4d0d-be97-bc390a92dc72', 'volume_name': 'volume-29c86d4e-c470-4d0d-be97-bc390a92dc72', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac74d555-f09d-4f71-943e-fab9fc2bf2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac74d555-f09d-4f71-943e-fab9fc2bf2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e2f789-1124-4fdf-833d-67c37450a5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Volume 29c86d4e-c470-4d0d-be97-bc390a92dc72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29c86d4e-c470-4d0d-be97-bc390a92dc72', 'volume_size': 1} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1002476912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29c86d4e-c470-4d0d-be97-bc390a92dc72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b008e7db92ac4755a7dd2b59c5ba0796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:35:39Z,use_quota=True,user_id='9f83a01570184a0382ff180422dfb315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Creating volume 29c86d4e-c470-4d0d-be97-bc390a92dc72 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:35:39 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:35:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:39 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 1073741824 Aug 05 15:35:39 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:41 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 1073741824" returned: 0 in 1.188s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:41 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 Aug 05 15:35:41 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:41 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72" returned: 0 in 0.507s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28e2f789-1124-4fdf-833d-67c37450a5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29c86d4e-c470-4d0d-be97-bc390a92dc72', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc998686-47f6-4f9e-ada6-b6bffb0aadeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:41 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Volume volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 (29c86d4e-c470-4d0d-be97-bc390a92dc72): created successfully Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc998686-47f6-4f9e-ada6-b6bffb0aadeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Flow 'volume_create_manager' (65383089-945b-432c-b9e2-117ae2e3634f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:35:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-15a8b33c-14b5-42e9-8834-b0b3a0b98248 tempest-ServerActionsTestOtherA-6679622 None] Created volume successfully. Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Flow 'volume_create_manager' (2966cd3a-d44d-4005-9d69-fcd3afb0b62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f43c41-cad0-4b53-be15-6affd51f3c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f43c41-cad0-4b53-be15-6affd51f3c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-910072602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de2914-8bdd-4e04-89f6-cbee0df6928f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fb8526540420e836f26afe04f13bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:35:48Z,use_quota=True,user_id='126cbc4ed0874f8d927110525eea7388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02af7b9e-dc2e-44d0-b455-265c13d0bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02af7b9e-dc2e-44d0-b455-265c13d0bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4851f9b2-9a0a-469e-8706-c277dac4c363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4851f9b2-9a0a-469e-8706-c277dac4c363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8de2914-8bdd-4e04-89f6-cbee0df6928f', 'volume_name': 'volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c66e50-ab1c-4f55-a49e-3ce0a42fc88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c66e50-ab1c-4f55-a49e-3ce0a42fc88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f5c72e-74c1-40a7-b159-85bf6c173ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Volume e8de2914-8bdd-4e04-89f6-cbee0df6928f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f', 'volume_size': 1} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:35:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-910072602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8de2914-8bdd-4e04-89f6-cbee0df6928f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fb8526540420e836f26afe04f13bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:35:48Z,use_quota=True,user_id='126cbc4ed0874f8d927110525eea7388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Creating volume e8de2914-8bdd-4e04-89f6-cbee0df6928f {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:35:47 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:35:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:47 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f 1073741824 Aug 05 15:35:47 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:48 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f 1073741824" returned: 0 in 0.591s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:48 devstack sudo[91918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f Aug 05 15:35:48 devstack sudo[91918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:48 devstack sudo[91918]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f5c72e-74c1-40a7-b159-85bf6c173ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64db592-3ea2-4dbe-bd5d-50f976ab3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Volume volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f (e8de2914-8bdd-4e04-89f6-cbee0df6928f): created successfully Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64db592-3ea2-4dbe-bd5d-50f976ab3249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Flow 'volume_create_manager' (2966cd3a-d44d-4005-9d69-fcd3afb0b62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:35:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4020bd51-fbb8-45f5-884d-f961e5fe4d40 tempest-ServersNegativeTestJSON-2085049293 None] Created volume successfully. Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Flow 'volume_create_manager' (5d20d397-a69f-451f-a15f-d1c397559b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6768dd-50bd-4ec0-b17a-cd464ee9ef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b6768dd-50bd-4ec0-b17a-cd464ee9ef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1600599046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d93fafb-19e9-41cf-8064-3ce6ecce7ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fb8526540420e836f26afe04f13bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:35:52Z,use_quota=True,user_id='126cbc4ed0874f8d927110525eea7388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cbbe44-0ac1-4784-a2a8-48623e24abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cbbe44-0ac1-4784-a2a8-48623e24abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff9fcaf-eccb-48ee-aac5-91cff23e0751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff9fcaf-eccb-48ee-aac5-91cff23e0751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d93fafb-19e9-41cf-8064-3ce6ecce7ecc', 'volume_name': 'volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298540b7-3e0a-41f1-a927-f77ef4fbb5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298540b7-3e0a-41f1-a927-f77ef4fbb5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989664b-0f39-42a6-aab9-1c1658eea432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:52 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Volume 4d93fafb-19e9-41cf-8064-3ce6ecce7ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc', 'volume_size': 1} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1600599046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d93fafb-19e9-41cf-8064-3ce6ecce7ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f5fb8526540420e836f26afe04f13bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:35:52Z,use_quota=True,user_id='126cbc4ed0874f8d927110525eea7388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Creating volume 4d93fafb-19e9-41cf-8064-3ce6ecce7ecc {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:35:52 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:35:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:52 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc 1073741824 Aug 05 15:35:52 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:53 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc 1073741824" returned: 0 in 0.554s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:53 devstack sudo[92051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc Aug 05 15:35:53 devstack sudo[92051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:53 devstack sudo[92051]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc" returned: 0 in 0.277s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989664b-0f39-42a6-aab9-1c1658eea432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b0f17-1c89-4444-ae4b-a9a9b96475ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:35:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Volume volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc (4d93fafb-19e9-41cf-8064-3ce6ecce7ecc): created successfully Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4b0f17-1c89-4444-ae4b-a9a9b96475ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:35:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Flow 'volume_create_manager' (5d20d397-a69f-451f-a15f-d1c397559b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:35:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-df549ea1-2477-4743-ac42-74716fe96cb1 tempest-ServersNegativeTestJSON-2085049293 None] Created volume successfully. Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "cinder-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "cinder-quobyte-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-quobyte-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e1349-fa24-4b60-9e28-05a3d8544201]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:55 devstack sudo[92058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc Aug 05 15:35:55 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:55 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc" returned: 0 in 0.418s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:55 devstack sudo[92064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc Aug 05 15:35:55 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:55 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-quobyte-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc" released by "delete_volume" :: held 0.721s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Created reservations ['59861b1a-6085-498a-889a-978616d774ac', '53b4aa9d-c1d0-411b-ac94-46d4e2b3b115', 'eb570f5e-2274-45aa-b37c-114e220073c0', 'f97b4850-a40c-4f9f-adee-56e90acbc540'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:56 devstack sudo[92067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:35:56 devstack sudo[92067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:56 devstack sudo[92067]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:35:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Deleted volume successfully. Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "cinder-e8de2914-8bdd-4e04-89f6-cbee0df6928f-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-e8de2914-8bdd-4e04-89f6-cbee0df6928f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bd205f16-95df-4ecd-892c-d37a6b0d05c5 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-4d93fafb-19e9-41cf-8064-3ce6ecce7ecc-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "cinder-quobyte-e8de2914-8bdd-4e04-89f6-cbee0df6928f" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-quobyte-e8de2914-8bdd-4e04-89f6-cbee0df6928f" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f238240-8171-4af9-8d0a-b6f384ce0867]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:56 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f Aug 05 15:35:56 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:56 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:56 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f Aug 05 15:35:56 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:57 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e8de2914-8bdd-4e04-89f6-cbee0df6928f" returned: 0 in 0.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-quobyte-e8de2914-8bdd-4e04-89f6-cbee0df6928f" released by "delete_volume" :: held 0.638s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Created reservations ['35136109-303a-4f06-a74f-a55615d6a2bb', '01701ea8-537f-486e-8964-58f6aa785f8e', '5fecfb12-628d-4670-853c-c9c8c4a90618', '980ed52e-70a3-4cf9-9c6b-6b59e942d218'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:35:57 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:35:57 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:35:57 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:35:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Deleted volume successfully. Aug 05 15:35:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dd68395e-a098-4006-aab2-859c6be9d9f3 tempest-ServersNegativeTestJSON-2085049293 None] Lock "cinder-e8de2914-8bdd-4e04-89f6-cbee0df6928f-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:07 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=26,cinder:SELECT=15,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:36:07 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=17,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=5 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:10 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:36:10 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-50d62d09-bb8d-4d8c-bfa3-c20d32ef7e54 req-1353f0c3-49b9-4e90-82ab-e8ceca2750b6 tempest-TaggedAttachmentsTest-1327224326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-50d62d09-bb8d-4d8c-bfa3-c20d32ef7e54 req-1353f0c3-49b9-4e90-82ab-e8ceca2750b6 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-50d62d09-bb8d-4d8c-bfa3-c20d32ef7e54 req-1353f0c3-49b9-4e90-82ab-e8ceca2750b6 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-50d62d09-bb8d-4d8c-bfa3-c20d32ef7e54 req-1353f0c3-49b9-4e90-82ab-e8ceca2750b6 tempest-TaggedAttachmentsTest-1327224326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0245e1e-6525-41ce-ac5c-41d53acbdca8', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:36:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-50d62d09-bb8d-4d8c-bfa3-c20d32ef7e54 req-1353f0c3-49b9-4e90-82ab-e8ceca2750b6 tempest-TaggedAttachmentsTest-1327224326 None] attachment_update completed successfully. Aug 05 15:36:10 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 8 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:36:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:36:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-ca5a4196-3049-4999-bb19-7e7ba96c6c2e req-f62d2305-af0a-4b40-9b72-e99d20c86758 tempest-TaggedAttachmentsTest-1327224326 None] Terminate volume connection completed successfully. Aug 05 15:36:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-ca5a4196-3049-4999-bb19-7e7ba96c6c2e req-f62d2305-af0a-4b40-9b72-e99d20c86758 tempest-TaggedAttachmentsTest-1327224326 None] Deleting attachment d0245e1e-6525-41ce-ac5c-41d53acbdca8. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Flow 'volume_create_manager' (20acedeb-0fd5-4e8f-8de2-82bb7ae947c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efee246-edc6-488e-99fe-c11de9a2dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6efee246-edc6-488e-99fe-c11de9a2dae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1351667114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17721d9-440a-4365-a609-7221e7f426d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedc21d703184029adc0e5df7b2efee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:36:17Z,use_quota=True,user_id='4a94bbc237884790bcbe339c1c497684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb26f009-7ebe-4b72-9553-3b1122b53b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb26f009-7ebe-4b72-9553-3b1122b53b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762579f6-d1cc-41d7-b502-bcad75ee8513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762579f6-d1cc-41d7-b502-bcad75ee8513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17721d9-440a-4365-a609-7221e7f426d7', 'volume_name': 'volume-e17721d9-440a-4365-a609-7221e7f426d7', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec5a912-a62e-4295-bc1e-95c747d514f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec5a912-a62e-4295-bc1e-95c747d514f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111c8d96-e654-4c31-a00d-bc86f8ecc604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:17 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Volume e17721d9-440a-4365-a609-7221e7f426d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17721d9-440a-4365-a609-7221e7f426d7', 'volume_size': 1} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:36:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1351667114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17721d9-440a-4365-a609-7221e7f426d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedc21d703184029adc0e5df7b2efee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:36:17Z,use_quota=True,user_id='4a94bbc237884790bcbe339c1c497684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Creating volume e17721d9-440a-4365-a609-7221e7f426d7 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:36:17 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:17 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 1073741824 Aug 05 15:36:17 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-a8fa3ba1-5c96-429c-b522-7b30a8b47e6e req-96ae2dbc-4f89-49b5-93f1-33359d56f98a tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:17 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 1073741824" returned: 0 in 0.480s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:17 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 Aug 05 15:36:17 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:17 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7" returned: 0 in 0.282s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-a8fa3ba1-5c96-429c-b522-7b30a8b47e6e req-96ae2dbc-4f89-49b5-93f1-33359d56f98a tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.545s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111c8d96-e654-4c31-a00d-bc86f8ecc604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17721d9-440a-4365-a609-7221e7f426d7', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb458b1e-ea04-4f57-802b-7c12c50c03ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-a8fa3ba1-5c96-429c-b522-7b30a8b47e6e req-96ae2dbc-4f89-49b5-93f1-33359d56f98a tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.117s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:18 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Volume volume-e17721d9-440a-4365-a609-7221e7f426d7 (e17721d9-440a-4365-a609-7221e7f426d7): created successfully Aug 05 15:36:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb458b1e-ea04-4f57-802b-7c12c50c03ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Flow 'volume_create_manager' (20acedeb-0fd5-4e8f-8de2-82bb7ae947c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:36:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-976b87c4-f7bc-4c41-80b5-1210b31c9b4e tempest-AttachVolumeTestJSON-1204103944 None] Created volume successfully. Aug 05 15:36:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-a8fa3ba1-5c96-429c-b522-7b30a8b47e6e req-96ae2dbc-4f89-49b5-93f1-33359d56f98a tempest-ServerActionsTestOtherA-6679622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-29c86d4e-c470-4d0d-be97-bc390a92dc72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c078edd6-b48b-4ac3-8a24-79239c54f24b', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:36:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-a8fa3ba1-5c96-429c-b522-7b30a8b47e6e req-96ae2dbc-4f89-49b5-93f1-33359d56f98a tempest-ServerActionsTestOtherA-6679622 None] attachment_update completed successfully. Aug 05 15:36:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:36:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Flow 'volume_create_manager' (e737d796-43c0-4c72-a93d-d465a86548a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:36:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7643d9a9-2a6c-4e9e-8031-d090c25a1cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7643d9a9-2a6c-4e9e-8031-d090c25a1cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-240433280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b3877d-38d7-4810-a724-b6495ba983b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc85768d96f46a6b5d0a8a96e61d5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:36:20Z,use_quota=True,user_id='8d5c8e267357429c8c180389ffd1ba7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e181f02-4d33-4181-bf44-9cb317198b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e181f02-4d33-4181-bf44-9cb317198b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb26abb-70e4-4cb3-b1c9-9fb4f6d6d20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb26abb-70e4-4cb3-b1c9-9fb4f6d6d20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b3877d-38d7-4810-a724-b6495ba983b5', 'volume_name': 'volume-e7b3877d-38d7-4810-a724-b6495ba983b5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3f0bfa-d2da-4ec5-b453-908e1ab81321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3f0bfa-d2da-4ec5-b453-908e1ab81321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5587da07-a306-4d9f-bb3b-adc5d1e2cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Volume e7b3877d-38d7-4810-a724-b6495ba983b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b3877d-38d7-4810-a724-b6495ba983b5', 'volume_size': 1} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-240433280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b3877d-38d7-4810-a724-b6495ba983b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc85768d96f46a6b5d0a8a96e61d5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:36:20Z,use_quota=True,user_id='8d5c8e267357429c8c180389ffd1ba7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Creating volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:36:20 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:20 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 1073741824 Aug 05 15:36:20 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-85ca3b6d-9699-42be-9626-7d347f416eae req-a9b8e55b-f910-4a20-80a0-4f4f98c2568f tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:20 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 1073741824" returned: 0 in 0.606s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:20 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 Aug 05 15:36:20 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:21 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5" returned: 0 in 0.314s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-85ca3b6d-9699-42be-9626-7d347f416eae req-a9b8e55b-f910-4a20-80a0-4f4f98c2568f tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.670s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-85ca3b6d-9699-42be-9626-7d347f416eae req-a9b8e55b-f910-4a20-80a0-4f4f98c2568f tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5587da07-a306-4d9f-bb3b-adc5d1e2cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b3877d-38d7-4810-a724-b6495ba983b5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc99e0c-b5bf-4f61-aaac-f00e2afd283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:36:21 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Volume volume-e7b3877d-38d7-4810-a724-b6495ba983b5 (e7b3877d-38d7-4810-a724-b6495ba983b5): created successfully Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc99e0c-b5bf-4f61-aaac-f00e2afd283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Flow 'volume_create_manager' (e737d796-43c0-4c72-a93d-d465a86548a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:36:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5846cd7d-a56a-4968-ac37-9cec9921dcc5 tempest-SnapshotsActionsTest-1189108944 None] Created volume successfully. Aug 05 15:36:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-85ca3b6d-9699-42be-9626-7d347f416eae req-a9b8e55b-f910-4a20-80a0-4f4f98c2568f tempest-AttachVolumeTestJSON-1204103944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-e17721d9-440a-4365-a609-7221e7f426d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36e54267-8d19-4caa-a02d-c68d83386eba', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:36:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-85ca3b6d-9699-42be-9626-7d347f416eae req-a9b8e55b-f910-4a20-80a0-4f4f98c2568f tempest-AttachVolumeTestJSON-1204103944 None] attachment_update completed successfully. Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Creating offline snapshot 197851be-11b8-4a20-b90a-40b9e606662a of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a9416-47db-40ed-bf30-d42e0ce7affd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:22 devstack sudo[93186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 Aug 05 15:36:22 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:22 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5" returned: 0 in 0.579s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:22 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a 1G Aug 05 15:36:22 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-d9c119e3-45d1-4a9a-8b13-a3253056199c tempest-ServerActionsTestOtherA-6679622 None] Terminate volume connection completed successfully. Aug 05 15:36:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-d9c119e3-45d1-4a9a-8b13-a3253056199c tempest-ServerActionsTestOtherA-6679622 None] Deleting attachment c078edd6-b48b-4ac3-8a24-79239c54f24b. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:36:23 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a 1G" returned: 0 in 0.659s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:23 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:23 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:24 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.626s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:24 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a is being set with open permissions: ugo+rw Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:24 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:24 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Acquiring lock "cinder-c8a0e89d-e7de-429c-aa95-c89e70d104a4-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Lock "cinder-c8a0e89d-e7de-429c-aa95-c89e70d104a4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Acquiring lock "cinder-quobyte-c8a0e89d-e7de-429c-aa95-c89e70d104a4" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Lock "cinder-quobyte-c8a0e89d-e7de-429c-aa95-c89e70d104a4" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f14737d-e597-4164-8cce-458427d25ed8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:24 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.397s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-fe300e5f-f867-413f-9e73-e722231bd349 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:24 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 Aug 05 15:36:24 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:24 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info Aug 05 15:36:24 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:24 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info" returned: 0 in 0.321s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:24 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info is being set with open permissions: ugo+rw Aug 05 15:36:24 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4" returned: 0 in 0.461s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:25 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info Aug 05 15:36:25 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:25 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4 Aug 05 15:36:25 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:25 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c8a0e89d-e7de-429c-aa95-c89e70d104a4" returned: 0 in 0.300s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:25 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.info" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Lock "cinder-quobyte-c8a0e89d-e7de-429c-aa95-c89e70d104a4" released by "delete_volume" :: held 0.853s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-fe300e5f-f867-413f-9e73-e722231bd349 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.719s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-fe300e5f-f867-413f-9e73-e722231bd349 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.096s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-08ca5a22-0d30-435f-bb32-cb9ce13b8bff tempest-SnapshotsActionsTest-1189108944 None] Create snapshot completed successfully Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-fe300e5f-f867-413f-9e73-e722231bd349 tempest-ServerActionsTestOtherA-6679622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-29c86d4e-c470-4d0d-be97-bc390a92dc72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76b5c833-c588-497f-ba47-59b84c283aa8', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Created reservations ['a88f6e8f-c9d7-469f-a0dc-08dad890f5f7', '51830746-865d-4c6f-aaa6-4687ee887e72', '9605e20e-5e3b-45c0-a0d5-df084683289a', 'ce0b08ba-cc91-40db-a6fd-510589ddc901'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-e87b41a8-9fac-45ae-9a25-6be15366e784 req-fe300e5f-f867-413f-9e73-e722231bd349 tempest-ServerActionsTestOtherA-6679622 None] attachment_update completed successfully. Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:25 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:36:25 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:25 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.264s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:36:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Deleted volume successfully. Aug 05 15:36:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-049fefb4-afd1-49f4-9662-38eead917123 tempest-TaggedAttachmentsTest-1327224326 None] Lock "cinder-c8a0e89d-e7de-429c-aa95-c89e70d104a4-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Creating offline snapshot a25a565c-0b8f-4e74-bd95-0aae922154b1 of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:36:27 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f593669-b9d4-48f4-8f77-6b2a23a15bf5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:27 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:27 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:28 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.628s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:28 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 1G Aug 05 15:36:28 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:28 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 1G" returned: 0 in 0.625s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:28 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 Aug 05 15:36:28 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:29 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:29 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 is being set with open permissions: ugo+rw Aug 05 15:36:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:29 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 Aug 05 15:36:29 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:29 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1" returned: 0 in 0.275s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-dce39e5b-fca4-4cee-947b-38a4b20aab55 tempest-SnapshotsActionsTest-1189108944 None] Create snapshot completed successfully Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-a25a565c-0b8f-4e74-bd95-0aae922154b1-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-a25a565c-0b8f-4e74-bd95-0aae922154b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-a25a565c-0b8f-4e74-bd95-0aae922154b1" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-a25a565c-0b8f-4e74-bd95-0aae922154b1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Deleting offline snapshot a25a565c-0b8f-4e74-bd95-0aae922154b1 of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] snapshot_file for this snap is: volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c373412d-ac83-4a30-accc-f2c54ce027bd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:34 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 Aug 05 15:36:34 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:34 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1" returned: 0 in 0.685s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf52a3b-bb7b-4532-a3d6-30857171f679]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:35 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:35 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:35 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.683s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:35 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 Aug 05 15:36:35 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:35 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1" returned: 0 in 0.384s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:35 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1 Aug 05 15:36:35 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:36 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.a25a565c-0b8f-4e74-bd95-0aae922154b1" returned: 0 in 0.277s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-a25a565c-0b8f-4e74-bd95-0aae922154b1" released by "_delete_snapshot" :: held 2.218s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" released by "delete_snapshot" :: held 2.252s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:36 devstack cinder-volume[88999]: WARNING cinder.quota [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:36:36 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Created reservations ['edc05fcf-85a3-4dd6-aa1c-49d1577c0fee', 'b1bb23ca-5490-4a5b-b3a2-bdef114d342c', 'c56be178-f810-450d-bad5-f50e835923d6', 'a6a5d506-de57-4bc0-835d-1c81934f4ae2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Delete snapshot completed successfully. Aug 05 15:36:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-77e77e9e-98e9-4e23-9f28-d868587dacda tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-a25a565c-0b8f-4e74-bd95-0aae922154b1-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Creating offline snapshot b0509d83-9a97-40bd-b861-0b90f273fc46 of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:36:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea404405-f5f6-4cd6-954f-083d8e4bbb40]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:38 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:38 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:38 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.593s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:38 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 1G Aug 05 15:36:38 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:39 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 1G" returned: 0 in 0.633s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:39 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 Aug 05 15:36:39 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:39 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46" returned: 0 in 0.315s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:39 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 is being set with open permissions: ugo+rw Aug 05 15:36:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:39 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 Aug 05 15:36:39 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:39 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46" returned: 0 in 0.305s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f0bd105e-688d-4bd9-9255-a790b99b1a55 tempest-SnapshotsActionsTest-1189108944 None] Create snapshot completed successfully Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-b0509d83-9a97-40bd-b861-0b90f273fc46-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-b0509d83-9a97-40bd-b861-0b90f273fc46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-b0509d83-9a97-40bd-b861-0b90f273fc46" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-b0509d83-9a97-40bd-b861-0b90f273fc46" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Deleting offline snapshot b0509d83-9a97-40bd-b861-0b90f273fc46 of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] snapshot_file for this snap is: volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf0a261-381d-4f4c-9cc0-1e1356bb1b8c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:40 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 Aug 05 15:36:40 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:40 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46" returned: 0 in 0.472s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eb1142-6867-4179-8cd7-40886cb1e9de]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:41 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:41 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:41 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.574s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:41 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 Aug 05 15:36:41 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:42 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46" returned: 0 in 0.620s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:42 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46 Aug 05 15:36:42 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:42 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.b0509d83-9a97-40bd-b861-0b90f273fc46" returned: 0 in 0.268s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-b0509d83-9a97-40bd-b861-0b90f273fc46" released by "_delete_snapshot" :: held 2.053s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" released by "delete_snapshot" :: held 2.085s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Created reservations ['233699b1-1c66-4efa-a4e5-442397f36411', '427c6653-d1d1-4e0f-a97a-72cfc9e26af6', '2cb461a8-85a8-489b-8489-607e9bd03879', '31d4dd16-7947-4a0e-8f7a-c4ffcca440b7'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Delete snapshot completed successfully. Aug 05 15:36:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef0af8de-1ee2-4507-8167-9e2138e3a510 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-b0509d83-9a97-40bd-b861-0b90f273fc46-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Creating offline snapshot 97d4bf6c-c105-4b22-bc74-b793950706fb of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:36:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1821db2e-f296-4325-952c-ef222de334df]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:44 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:44 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:44 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.557s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:44 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb 1G Aug 05 15:36:44 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:45 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb 1G" returned: 0 in 0.672s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:45 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb Aug 05 15:36:45 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:45 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:45 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb is being set with open permissions: ugo+rw Aug 05 15:36:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:45 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb Aug 05 15:36:45 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:45 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb" returned: 0 in 0.248s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-76677bec-1b05-4ce9-a802-5c0fd47787fd tempest-SnapshotsActionsTest-1189108944 None] Create snapshot completed successfully Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-97d4bf6c-c105-4b22-bc74-b793950706fb-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-97d4bf6c-c105-4b22-bc74-b793950706fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-97d4bf6c-c105-4b22-bc74-b793950706fb" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-97d4bf6c-c105-4b22-bc74-b793950706fb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Deleting offline snapshot 97d4bf6c-c105-4b22-bc74-b793950706fb of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] snapshot_file for this snap is: volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[df25d26d-699d-490b-b983-3c969a062ee8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:46 devstack sudo[94038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb Aug 05 15:36:46 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:46 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[90aaec3a-c1d9-4d1d-8962-f9aa458de886]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:46 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:46 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:46 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.369s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:46 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb Aug 05 15:36:46 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:47 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb" returned: 0 in 0.371s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:47 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb Aug 05 15:36:47 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:47 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.97d4bf6c-c105-4b22-bc74-b793950706fb" returned: 0 in 0.249s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-97d4bf6c-c105-4b22-bc74-b793950706fb" released by "_delete_snapshot" :: held 1.433s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" released by "delete_snapshot" :: held 1.457s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Created reservations ['261159b3-68d0-4317-be64-5a98c96b04f3', '09fbcf0e-c52c-441c-8af9-65437cac3964', '8214d39a-d0c7-4d28-9076-3aaf09c54758', '5f8c5dc4-cae6-463b-8148-ccb6fe5ce28c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Delete snapshot completed successfully. Aug 05 15:36:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fa9a1e49-eac5-438c-be8c-a88e108f5e90 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-97d4bf6c-c105-4b22-bc74-b793950706fb-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Creating offline snapshot 4f5268fc-53d4-4140-ae3a-d3e30623b76a of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c58080-0540-4d09-ba91-067f9bab7ea9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:48 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:48 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:48 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:48 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a 1G Aug 05 15:36:48 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:49 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a 1G" returned: 0 in 0.456s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:49 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a Aug 05 15:36:49 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:49 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a" returned: 0 in 0.295s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:49 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a is being set with open permissions: ugo+rw Aug 05 15:36:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:49 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a Aug 05 15:36:49 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:49 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a" returned: 0 in 0.256s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.481s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1cdabdca-0da1-4721-852d-603b0b88d83f tempest-SnapshotsActionsTest-1189108944 None] Create snapshot completed successfully Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-4f5268fc-53d4-4140-ae3a-d3e30623b76a-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-4f5268fc-53d4-4140-ae3a-d3e30623b76a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Acquiring lock "cinder-quobyte-4f5268fc-53d4-4140-ae3a-d3e30623b76a" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-4f5268fc-53d4-4140-ae3a-d3e30623b76a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Deleting offline snapshot 4f5268fc-53d4-4140-ae3a-d3e30623b76a of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] snapshot_file for this snap is: volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9b2c15-f005-4eac-9d15-2de190fe2ea2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:50 devstack sudo[94101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a Aug 05 15:36:50 devstack sudo[94101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:51 devstack sudo[94101]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a" returned: 0 in 0.506s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:51 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a918e1-2c27-4a5e-b83b-829f1fba4c80]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:51 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:51 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:52 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.589s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:52 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a Aug 05 15:36:52 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:52 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a" returned: 0 in 0.517s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:52 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a Aug 05 15:36:52 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:52 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.4f5268fc-53d4-4140-ae3a-d3e30623b76a" returned: 0 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-4f5268fc-53d4-4140-ae3a-d3e30623b76a" released by "_delete_snapshot" :: held 2.112s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" released by "delete_snapshot" :: held 2.140s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:53 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Created reservations ['46a425b4-746a-40ea-9e4a-f5e980aacd04', '8c85c68b-b75b-4109-b996-2a6345994f51', '1e58a4b0-950b-4469-bdf7-8df7a6bd1f33', '6093d6cd-18bd-4221-97f7-3aec0ae305f1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Delete snapshot completed successfully. Aug 05 15:36:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bffd1c73-91d2-49f5-b45c-b29a5558d620 tempest-SnapshotsActionsTest-1443571885 None] Lock "cinder-4f5268fc-53d4-4140-ae3a-d3e30623b76a-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "cinder-197851be-11b8-4a20-b90a-40b9e606662a-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-197851be-11b8-4a20-b90a-40b9e606662a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "cinder-quobyte-197851be-11b8-4a20-b90a-40b9e606662a" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-quobyte-197851be-11b8-4a20-b90a-40b9e606662a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Deleting offline snapshot 197851be-11b8-4a20-b90a-40b9e606662a of volume e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] snapshot_file for this snap is: volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef870d1-853a-48bd-ac1f-6d7b0e03e9a2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:54 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:54 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:55 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.557s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b3877d-38d7-4810-a724-b6495ba983b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e07a61-ca1e-46c6-8fc3-1b475bd91292]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:55 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 Aug 05 15:36:55 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-59eb5488-fec1-4ee7-ae4c-2afdb990bc7d req-004ce6a0-fd2a-4b06-b939-3ebd1e518b7c tempest-AttachVolumeTestJSON-1204103944 None] Terminate volume connection completed successfully. Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-59eb5488-fec1-4ee7-ae4c-2afdb990bc7d req-004ce6a0-fd2a-4b06-b939-3ebd1e518b7c tempest-AttachVolumeTestJSON-1204103944 None] Deleting attachment 36e54267-8d19-4caa-a02d-c68d83386eba. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:36:55 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5" returned: 0 in 0.668s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:55 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:55 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:56 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.679s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:56 devstack sudo[94154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a Aug 05 15:36:56 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:56 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5.197851be-11b8-4a20-b90a-40b9e606662a" returned: 0 in 0.406s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-8e485e71-66ab-41cd-a5a8-42b98e7ef38a req-abae03b8-4416-4b8d-9ef2-42beeb4c560d tempest-ServerActionsTestOtherA-6679622 None] Terminate volume connection completed successfully. Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-8e485e71-66ab-41cd-a5a8-42b98e7ef38a req-abae03b8-4416-4b8d-9ef2-42beeb4c560d tempest-ServerActionsTestOtherA-6679622 None] Deleting attachment 76b5c833-c588-497f-ba47-59b84c283aa8. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-quobyte-197851be-11b8-4a20-b90a-40b9e606662a" released by "_delete_snapshot" :: held 2.540s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" released by "delete_snapshot" :: held 2.586s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Created reservations ['56c9015e-4225-4728-8446-a72494f4f86b', '239528df-152f-43dc-9c85-d211156cfcb0', 'f36f1af9-8c1b-4be0-bcb7-98f468212365', '2a2af1a5-3516-4efd-bf06-fa7dad1ce3bc'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Delete snapshot completed successfully. Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5adb745-1ce5-45ba-bc74-f7dc090c54eb tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-197851be-11b8-4a20-b90a-40b9e606662a-delete_snapshot" released by "delete_snapshot" :: held 2.812s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "cinder-e7b3877d-38d7-4810-a724-b6495ba983b5-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-e7b3877d-38d7-4810-a724-b6495ba983b5-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:36:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:36:58 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e726d1f8-1d31-4607-8842-461ebac0f991]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:36:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:58 devstack sudo[94179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 Aug 05 15:36:58 devstack sudo[94179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:58 devstack sudo[94179]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5" returned: 0 in 0.601s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:58 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5 Aug 05 15:36:58 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:59 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7b3877d-38d7-4810-a724-b6495ba983b5" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-quobyte-e7b3877d-38d7-4810-a724-b6495ba983b5" released by "delete_volume" :: held 1.011s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Created reservations ['f414cf76-f07a-4ee8-803d-b97684ad3520', '28d1f0fe-ef86-4bf6-bc0d-9c05177be5ee', '889895fc-c5a6-4c74-b196-847972fee10c', '080fb657-3764-4d35-81ad-a03817c0965d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:36:59 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:36:59 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:36:59 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.291s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:36:59 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Deleted volume successfully. Aug 05 15:36:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-49cba4a6-ceb6-44da-97e0-714025b6a743 tempest-SnapshotsActionsTest-1189108944 None] Lock "cinder-e7b3877d-38d7-4810-a724-b6495ba983b5-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Flow 'volume_create_manager' (6a3dc0fe-ad88-4125-a5d3-45397705a677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd195d5-c6a1-474a-8c94-ea743427f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd195d5-c6a1-474a-8c94-ea743427f534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1465321113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f103c9-578c-4a7f-87d0-d1e4719b04cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b008e7db92ac4755a7dd2b59c5ba0796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:06Z,use_quota=True,user_id='9f83a01570184a0382ff180422dfb315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf13375-10ad-45b4-b219-a39f3436a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf13375-10ad-45b4-b219-a39f3436a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b027ec17-26f2-48b1-bc2c-319e46428c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:06 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:37:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b027ec17-26f2-48b1-bc2c-319e46428c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9f103c9-578c-4a7f-87d0-d1e4719b04cb', 'volume_name': 'volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8f6bb1-6ed4-453b-800a-133e0a0a2c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8f6bb1-6ed4-453b-800a-133e0a0a2c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16ecd88-3871-469e-996a-d3377eb71c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Volume f9f103c9-578c-4a7f-87d0-d1e4719b04cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:37:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Trying to clone f9f103c9-578c-4a7f-87d0-d1e4719b04cb from image 84e9902b-fdcb-400c-bb6e-673761bd149d at location (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:37:08 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:37:08 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:37:08 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7270fd2-cdb1-457b-aa27-d7031085f6cb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:08 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD Aug 05 15:37:08 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:08 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:08 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d is fetched for user 9f83a01570184a0382ff180422dfb315. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=92,cinder:UPDATE=69,cinder:INSERT=15,cinder:DELETE=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=75,cinder:UPDATE=55,cinder:DELETE=7,cinder:INSERT=16 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab9acf-7d2f-417e-8686-599e02456b81]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Flow 'volume_create_manager' (b41e8f21-de67-436f-8cf9-c4fc18d9e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19178dbe-721a-41ac-9a8f-d2b43b6c4cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19178dbe-721a-41ac-9a8f-d2b43b6c4cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-60219387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912505a5-37eb-4f4a-910a-5e60718bf051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af1a62a284c4f6ab6976faa5dbb3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:09Z,use_quota=True,user_id='f8b38f3bed084cb4bc94fec72a0f6c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dca8697-a632-48c8-9d07-53de26e66fc8),volume_type_id=0dca8697-a632-48c8-9d07-53de26e66fc8)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:09 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD Aug 05 15:37:09 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd1929f-eb53-4765-8452-0bc68363d302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abd1929f-eb53-4765-8452-0bc68363d302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e2f8db-7f84-4af9-b8b9-6012a5e44c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e2f8db-7f84-4af9-b8b9-6012a5e44c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912505a5-37eb-4f4a-910a-5e60718bf051', 'volume_name': 'volume-912505a5-37eb-4f4a-910a-5e60718bf051', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55121f38-fb58-410d-8991-dd50217464b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55121f38-fb58-410d-8991-dd50217464b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6600b3-a4b4-425c-84ad-238b505e08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:09 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Volume 912505a5-37eb-4f4a-910a-5e60718bf051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912505a5-37eb-4f4a-910a-5e60718bf051', 'volume_size': 1} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-60219387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912505a5-37eb-4f4a-910a-5e60718bf051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7af1a62a284c4f6ab6976faa5dbb3a39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:09Z,use_quota=True,user_id='f8b38f3bed084cb4bc94fec72a0f6c0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0dca8697-a632-48c8-9d07-53de26e66fc8),volume_type_id=0dca8697-a632-48c8-9d07-53de26e66fc8)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Creating volume 912505a5-37eb-4f4a-910a-5e60718bf051 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:37:09 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:09 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 1073741824 Aug 05 15:37:09 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:09 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:09 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 1073741824" returned: 0 in 0.583s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:10 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 Aug 05 15:37:10 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:10 devstack sudo[94433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:37:10 devstack sudo[94433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:10 devstack sudo[94433]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.548s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:37:10 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051" returned: 0 in 0.755s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.147s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1465321113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f103c9-578c-4a7f-87d0-d1e4719b04cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b008e7db92ac4755a7dd2b59c5ba0796',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:06Z,use_quota=True,user_id='9f83a01570184a0382ff180422dfb315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Creating volume f9f103c9-578c-4a7f-87d0-d1e4719b04cb {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:37:10 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:10 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb 1073741824 Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6600b3-a4b4-425c-84ad-238b505e08af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912505a5-37eb-4f4a-910a-5e60718bf051', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:10 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1565e8-0bce-4d30-b335-6f54cc1de28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Volume volume-912505a5-37eb-4f4a-910a-5e60718bf051 (912505a5-37eb-4f4a-910a-5e60718bf051): created successfully Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1565e8-0bce-4d30-b335-6f54cc1de28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Flow 'volume_create_manager' (b41e8f21-de67-436f-8cf9-c4fc18d9e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ff38440e-d65b-4e6b-a323-fdb47ccc75a1 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Created volume successfully. Aug 05 15:37:11 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb 1073741824" returned: 0 in 1.103s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:12 devstack sudo[94503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb Aug 05 15:37:12 devstack sudo[94503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:12 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:37:12 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:12 devstack sudo[94503]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" returned: 0 in 0.397s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Attempting download of 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume f9f103c9-578c-4a7f-87d0-d1e4719b04cb. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5606f40-961c-47ec-be67-e93bc18aa321]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:12 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.380s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:37:12 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5f897e76-cac2-4f5d-85e6-42ca99ecd291 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Retype volume completed successfully. Aug 05 15:37:12 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d Aug 05 15:37:12 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:12 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d" returned: 0 in 0.379s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:13 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d Aug 05 15:37:13 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:13 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d" returned: 1 in 0.538s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_3c5jkh5d' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0526e7f-6a40-4559-a214-b7a14bed3002]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:13 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD Aug 05 15:37:13 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Acquiring lock "cinder-912505a5-37eb-4f4a-910a-5e60718bf051-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "cinder-912505a5-37eb-4f4a-910a-5e60718bf051-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Acquiring lock "cinder-quobyte-912505a5-37eb-4f4a-910a-5e60718bf051" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "cinder-quobyte-912505a5-37eb-4f4a-910a-5e60718bf051" acquired by "delete_volume" :: waited 0.045s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d050d-b9b0-4055-8de4-700bb46707a5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:14 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 Aug 05 15:37:14 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:14 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:14 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] 84e9902b-fdcb-400c-bb6e-673761bd149d was qcow2, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:37:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:14 devstack sudo[94542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb Aug 05 15:37:14 devstack sudo[94542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:14 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051" returned: 0 in 0.569s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:14 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051 Aug 05 15:37:14 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:15 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-912505a5-37eb-4f4a-910a-5e60718bf051" returned: 0 in 0.455s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "cinder-quobyte-912505a5-37eb-4f4a-910a-5e60718bf051" released by "delete_volume" :: held 1.123s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:15 devstack cinder-volume[88999]: WARNING cinder.quota [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:37:15 devstack cinder-volume[88999]: WARNING cinder.quota [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Created reservations ['148706c8-3a44-4621-bc7a-c7ed9349f948', '8335ef92-16a9-42c8-bab9-cd56f10598e4', '379c1ac1-f220-4ff1-a658-ff51142ad521', '3535bc1a-42ef-416f-b47f-beee25a34d28'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:15 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:37:15 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:15 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.512s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:37:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Deleted volume successfully. Aug 05 15:37:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d1163273-989e-4bfd-a534-9d0498fcc138 tempest-VolumeRetypeWithoutMigrationTest-298922225 None] Lock "cinder-912505a5-37eb-4f4a-910a-5e60718bf051-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:16 devstack sudo[94542]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" returned: 0 in 2.708s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:16 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_0hoqgzdzdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:37:16 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Converted 112.00 MB image at 41.34 MB/s Aug 05 15:37:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:16 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb 1G Aug 05 15:37:16 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:17 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb 1G" returned: 0 in 0.447s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Downloaded image 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume f9f103c9-578c-4a7f-87d0-d1e4719b04cb successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d for user 9f83a01570184a0382ff180422dfb315 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Marking volume f9f103c9-578c-4a7f-87d0-d1e4719b04cb as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Copying metadata from image 84e9902b-fdcb-400c-bb6e-673761bd149d to f9f103c9-578c-4a7f-87d0-d1e4719b04cb. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Creating volume glance metadata for volume f9f103c9-578c-4a7f-87d0-d1e4719b04cb backed by image 84e9902b-fdcb-400c-bb6e-673761bd149d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16ecd88-3871-469e-996a-d3377eb71c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9e1342-64ab-4927-a4ff-5d753cacb618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:17 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Volume volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb (f9f103c9-578c-4a7f-87d0-d1e4719b04cb): created successfully Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b9e1342-64ab-4927-a4ff-5d753cacb618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Flow 'volume_create_manager' (6a3dc0fe-ad88-4125-a5d3-45397705a677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7edc469f-8050-4741-9c4e-9aff8c742780 tempest-ServerActionsTestOtherA-6679622 None] Created volume successfully. Aug 05 15:37:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-01302984-37d1-4060-8eb0-da5321e1e44f req-58c11add-7ab9-4e2a-ba9c-00b51de3c42f tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-01302984-37d1-4060-8eb0-da5321e1e44f req-58c11add-7ab9-4e2a-ba9c-00b51de3c42f tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-01302984-37d1-4060-8eb0-da5321e1e44f req-58c11add-7ab9-4e2a-ba9c-00b51de3c42f tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-01302984-37d1-4060-8eb0-da5321e1e44f req-58c11add-7ab9-4e2a-ba9c-00b51de3c42f tempest-ServerActionsTestOtherA-6679622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bf7a6d8-3ba7-4dc5-8520-8d023538eb4b', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:37:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-01302984-37d1-4060-8eb0-da5321e1e44f req-58c11add-7ab9-4e2a-ba9c-00b51de3c42f tempest-ServerActionsTestOtherA-6679622 None] attachment_update completed successfully. Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:INSERT=8,cinder:SELECT=32,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=22,cinder:SELECT=24,cinder:INSERT=11,cinder:DELETE=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Flow 'volume_create_manager' (2f867041-71cc-40d6-aeeb-d8d95bacace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c39ff9-74e1-4d91-95bc-df0ca2e73516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c39ff9-74e1-4d91-95bc-df0ca2e73516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1746989743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5562e22c-cdce-4dea-a9d5-3980e8940b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13635303bbd544f8b386f98a1b61cac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:32Z,use_quota=True,user_id='a23dfc9167f345099c9107527657df55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3825206b-801d-4adc-bdfd-a8d59354a677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3825206b-801d-4adc-bdfd-a8d59354a677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee525c9-5d30-4436-9cb3-8c37ed8e92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee525c9-5d30-4436-9cb3-8c37ed8e92ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5562e22c-cdce-4dea-a9d5-3980e8940b65', 'volume_name': 'volume-5562e22c-cdce-4dea-a9d5-3980e8940b65', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af689293-3bd2-44ab-9d9d-3966e4580a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af689293-3bd2-44ab-9d9d-3966e4580a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc79a4f-57bc-489f-b28f-84c4d0894e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Volume 5562e22c-cdce-4dea-a9d5-3980e8940b65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5562e22c-cdce-4dea-a9d5-3980e8940b65', 'volume_size': 1} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1746989743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5562e22c-cdce-4dea-a9d5-3980e8940b65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13635303bbd544f8b386f98a1b61cac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:32Z,use_quota=True,user_id='a23dfc9167f345099c9107527657df55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Creating volume 5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:37:31 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:37:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:31 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 1073741824 Aug 05 15:37:31 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:32 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 1073741824" returned: 0 in 0.647s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:32 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 Aug 05 15:37:32 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:32 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65" returned: 0 in 0.360s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc79a4f-57bc-489f-b28f-84c4d0894e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5562e22c-cdce-4dea-a9d5-3980e8940b65', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec328e3-4fe5-46eb-84b6-4ac52cc2eaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Volume volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 (5562e22c-cdce-4dea-a9d5-3980e8940b65): created successfully Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ec328e3-4fe5-46eb-84b6-4ac52cc2eaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Flow 'volume_create_manager' (2f867041-71cc-40d6-aeeb-d8d95bacace3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-53c952c0-5fff-42ec-8cb8-b0318276f5b2 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Created volume successfully. Aug 05 15:37:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Creating offline snapshot 10d12a31-4d62-438f-a470-0f4b89adb91c of volume 5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:37:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a524c0-7f55-4168-abf3-441635d34f8a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:34 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 Aug 05 15:37:34 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:35 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65" returned: 0 in 0.866s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:35 devstack sudo[95131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c 1G Aug 05 15:37:35 devstack sudo[95131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:36 devstack sudo[95131]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c 1G" returned: 0 in 0.820s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:36 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c Aug 05 15:37:36 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:36 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c" returned: 0 in 0.463s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:36 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c is being set with open permissions: ugo+rw Aug 05 15:37:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:36 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c Aug 05 15:37:36 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:36 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c" returned: 0 in 0.440s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:37 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info Aug 05 15:37:37 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Flow 'volume_create_manager' (b15bd78c-ffda-46bb-b95a-edbc560b8bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8353b1-22b2-44af-8d9a-6d827e9db839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8353b1-22b2-44af-8d9a-6d827e9db839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-499092513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e7e889-977f-46f7-9a52-0674e6e0f8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c28ea541af4e93af70296f357ec286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:37Z,use_quota=True,user_id='7f783f227cd945ee9e3729c348f1a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cb2216-2e57-4390-b6f7-56648665d2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76cb2216-2e57-4390-b6f7-56648665d2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5927a8e6-8a0b-457e-8556-1edc2da56786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5927a8e6-8a0b-457e-8556-1edc2da56786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3e7e889-977f-46f7-9a52-0674e6e0f8db', 'volume_name': 'volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913ef858-a74b-438d-acb1-3690363525e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (913ef858-a74b-438d-acb1-3690363525e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:37 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a9a49e-9c01-41e8-9439-4aebf88d363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:37 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Volume a3e7e889-977f-46f7-9a52-0674e6e0f8db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db', 'volume_size': 1} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info" returned: 0 in 0.589s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:37 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info is being set with open permissions: ugo+rw Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:37 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info Aug 05 15:37:37 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:37 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.info" returned: 0 in 0.293s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.683s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-499092513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3e7e889-977f-46f7-9a52-0674e6e0f8db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c28ea541af4e93af70296f357ec286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:37:37Z,use_quota=True,user_id='7f783f227cd945ee9e3729c348f1a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Creating volume a3e7e889-977f-46f7-9a52-0674e6e0f8db {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:37:37 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:37:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-29d29f83-0e13-4988-ade7-b535726e3173 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Create snapshot completed successfully Aug 05 15:37:38 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db 1073741824 Aug 05 15:37:38 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:38 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db 1073741824" returned: 0 in 0.758s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:38 devstack sudo[95162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db Aug 05 15:37:38 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:39 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db" returned: 0 in 0.420s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a9a49e-9c01-41e8-9439-4aebf88d363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62df7024-d594-46df-83c4-0d4b20d93354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:37:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Volume volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db (a3e7e889-977f-46f7-9a52-0674e6e0f8db): created successfully Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62df7024-d594-46df-83c4-0d4b20d93354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Flow 'volume_create_manager' (b15bd78c-ffda-46bb-b95a-edbc560b8bad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:37:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-57b3939a-e05f-4cbd-b067-f566cd0c6e84 tempest-AttachVolumeNegativeTest-310103733 None] Created volume successfully. Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "cinder-10d12a31-4d62-438f-a470-0f4b89adb91c-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-10d12a31-4d62-438f-a470-0f4b89adb91c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "cinder-quobyte-5562e22c-cdce-4dea-a9d5-3980e8940b65" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-quobyte-5562e22c-cdce-4dea-a9d5-3980e8940b65" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "cinder-quobyte-10d12a31-4d62-438f-a470-0f4b89adb91c" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-quobyte-10d12a31-4d62-438f-a470-0f4b89adb91c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Deleting offline snapshot 10d12a31-4d62-438f-a470-0f4b89adb91c of volume 5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] snapshot_file for this snap is: volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b6e366-6838-4787-ae1d-7b359d7312c8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:39 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c Aug 05 15:37:39 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:40 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c" returned: 0 in 0.844s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5562e22c-cdce-4dea-a9d5-3980e8940b65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[601946c0-8292-46dd-9fa4-f73d30ebb815]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:40 devstack sudo[95182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 Aug 05 15:37:40 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d06332fe-3d35-41b7-a7b3-fb9b162a65d4 req-72accb15-6b35-4318-ad3a-436e48c12db3 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d06332fe-3d35-41b7-a7b3-fb9b162a65d4 req-72accb15-6b35-4318-ad3a-436e48c12db3 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d06332fe-3d35-41b7-a7b3-fb9b162a65d4 req-72accb15-6b35-4318-ad3a-436e48c12db3 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-d06332fe-3d35-41b7-a7b3-fb9b162a65d4 req-72accb15-6b35-4318-ad3a-436e48c12db3 tempest-AttachVolumeNegativeTest-310103733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd97a0150-4b0c-42f8-94dc-187f5f3e7215', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:37:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-d06332fe-3d35-41b7-a7b3-fb9b162a65d4 req-72accb15-6b35-4318-ad3a-436e48c12db3 tempest-AttachVolumeNegativeTest-310103733 None] attachment_update completed successfully. Aug 05 15:37:41 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65" returned: 0 in 0.685s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:41 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c Aug 05 15:37:41 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:41 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c" returned: 0 in 0.378s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:41 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c Aug 05 15:37:41 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:42 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65.10d12a31-4d62-438f-a470-0f4b89adb91c" returned: 0 in 0.531s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-quobyte-10d12a31-4d62-438f-a470-0f4b89adb91c" released by "_delete_snapshot" :: held 2.669s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-6540b8e7-eb13-467f-aa2c-e61f9c171dae tempest-ServerActionsTestOtherA-6679622 None] Terminate volume connection completed successfully. Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-6540b8e7-eb13-467f-aa2c-e61f9c171dae tempest-ServerActionsTestOtherA-6679622 None] Deleting attachment 6bf7a6d8-3ba7-4dc5-8520-8d023538eb4b. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-quobyte-5562e22c-cdce-4dea-a9d5-3980e8940b65" released by "delete_snapshot" :: held 2.747s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Created reservations ['260fc919-c589-4930-975b-b60fa15a571d', 'a91a4e13-cf1a-4229-ae13-ae519527a2a0', 'e8295be5-a027-46e1-bcd2-38b299c724af', '6a0dd827-4582-4aaa-bfbb-dc042bb91c6b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:37:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Delete snapshot completed successfully. Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-815ae3b1-d64c-49b2-89db-762a82683fc0 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-10d12a31-4d62-438f-a470-0f4b89adb91c-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "cinder-5562e22c-cdce-4dea-a9d5-3980e8940b65-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-5562e22c-cdce-4dea-a9d5-3980e8940b65-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "cinder-quobyte-5562e22c-cdce-4dea-a9d5-3980e8940b65" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:37:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-quobyte-5562e22c-cdce-4dea-a9d5-3980e8940b65" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:37:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bd274d-62a5-4f0d-810b-47ddea041586]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:37:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:43 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 Aug 05 15:37:43 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:43 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65" returned: 0 in 0.496s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:43 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65 Aug 05 15:37:43 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:43 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5562e22c-cdce-4dea-a9d5-3980e8940b65" returned: 0 in 0.422s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-quobyte-5562e22c-cdce-4dea-a9d5-3980e8940b65" released by "delete_volume" :: held 1.016s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Created reservations ['5e56c2e9-b504-4abe-b9e4-22508f271412', '30f77db4-ec1d-4465-a1cc-6bdf2105ebf5', '74bfcf4a-1877-493f-a0a3-1aaf0bee9b96', '353a519b-d83d-4887-8df2-1b7962bbfc81'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:37:44 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:37:44 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:37:44 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.341s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:37:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Deleted volume successfully. Aug 05 15:37:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d586881d-d65f-4ab5-a087-9e1990a75bd9 tempest-VolumeSnapshotQuotasNegativeTestJSON-605486598 None] Lock "cinder-5562e22c-cdce-4dea-a9d5-3980e8940b65-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:37:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-074663f5-a39d-40d1-80b3-a087092288b3 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:37:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-074663f5-a39d-40d1-80b3-a087092288b3 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:37:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-074663f5-a39d-40d1-80b3-a087092288b3 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:37:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-074663f5-a39d-40d1-80b3-a087092288b3 tempest-ServerActionsTestOtherA-6679622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4efc027e-cc19-4cf2-9fbb-3ea4c7d3d490', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:37:46 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-37283b97-38a5-4733-93b5-bcbcde88a97f req-074663f5-a39d-40d1-80b3-a087092288b3 tempest-ServerActionsTestOtherA-6679622 None] attachment_update completed successfully. Aug 05 15:37:56 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=4 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:37:56 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=34,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Flow 'volume_create_manager' (fe4d15e7-3650-45eb-b743-19b4b8a6cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb5b69f-8acc-4100-9a6d-be52b1c7d4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb5b69f-8acc-4100-9a6d-be52b1c7d4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-831869584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c251533-f288-40a9-a6d1-fc0d358561a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c296710904b2281c4fa84867d7287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:08Z,use_quota=True,user_id='57a6b78a8ce84d419140c7085e6cc1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc43d437-7628-4f3c-a7a0-dbf2e90d05a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc43d437-7628-4f3c-a7a0-dbf2e90d05a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed65598-2a23-4448-9c23-c7430b26208e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed65598-2a23-4448-9c23-c7430b26208e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c251533-f288-40a9-a6d1-fc0d358561a9', 'volume_name': 'volume-3c251533-f288-40a9-a6d1-fc0d358561a9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0519b05-9817-447f-914f-d53c5301b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0519b05-9817-447f-914f-d53c5301b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c559330-86b3-424e-a2ea-ed9340dd9a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Volume 3c251533-f288-40a9-a6d1-fc0d358561a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c251533-f288-40a9-a6d1-fc0d358561a9', 'volume_size': 1} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-831869584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c251533-f288-40a9-a6d1-fc0d358561a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c296710904b2281c4fa84867d7287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:08Z,use_quota=True,user_id='57a6b78a8ce84d419140c7085e6cc1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Creating volume 3c251533-f288-40a9-a6d1-fc0d358561a9 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:08 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:08 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 1073741824 Aug 05 15:38:08 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:08 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 1073741824" returned: 0 in 0.469s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:08 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 Aug 05 15:38:08 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:08 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9" returned: 0 in 0.260s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c559330-86b3-424e-a2ea-ed9340dd9a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c251533-f288-40a9-a6d1-fc0d358561a9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e250f8a-1d4e-43d7-a162-75e7e01e714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Volume volume-3c251533-f288-40a9-a6d1-fc0d358561a9 (3c251533-f288-40a9-a6d1-fc0d358561a9): created successfully Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e250f8a-1d4e-43d7-a162-75e7e01e714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Flow 'volume_create_manager' (fe4d15e7-3650-45eb-b743-19b4b8a6cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:08 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f54bfa2b-e1d3-43ac-8e87-a7bbdff2d8a3 tempest-VolumesListAdminTestJSON-312238572 None] Created volume successfully. Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:10 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:10 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:10 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Flow 'volume_create_manager' (dc169464-e8de-4c6a-89b9-f8c087937c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b10b8d0-a9c5-4d4c-ad2f-59a1b5a0324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b10b8d0-a9c5-4d4c-ad2f-59a1b5a0324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581832216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24bae35-65ce-43a7-bcf0-676f17c00249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c296710904b2281c4fa84867d7287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:11Z,use_quota=True,user_id='57a6b78a8ce84d419140c7085e6cc1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cbfbf9-33f8-4606-aa79-266d314d0699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0cbfbf9-33f8-4606-aa79-266d314d0699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e58a948-0b2a-4a70-aeef-c49dd6da1dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e58a948-0b2a-4a70-aeef-c49dd6da1dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24bae35-65ce-43a7-bcf0-676f17c00249', 'volume_name': 'volume-d24bae35-65ce-43a7-bcf0-676f17c00249', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba86c70-b9fa-4ac7-a070-d64ecdaac0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ba86c70-b9fa-4ac7-a070-d64ecdaac0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379d3ac2-7959-44eb-8b22-ad896566526f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Volume d24bae35-65ce-43a7-bcf0-676f17c00249: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24bae35-65ce-43a7-bcf0-676f17c00249', 'volume_size': 1} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-581832216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24bae35-65ce-43a7-bcf0-676f17c00249,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c296710904b2281c4fa84867d7287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:11Z,use_quota=True,user_id='57a6b78a8ce84d419140c7085e6cc1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Creating volume d24bae35-65ce-43a7-bcf0-676f17c00249 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:10 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:10 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 1073741824 Aug 05 15:38:10 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:11 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 1073741824" returned: 0 in 0.412s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:11 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 Aug 05 15:38:11 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:11 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249" returned: 0 in 0.245s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (379d3ac2-7959-44eb-8b22-ad896566526f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24bae35-65ce-43a7-bcf0-676f17c00249', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3fe9be-965d-41f5-b419-e2672f3757cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Volume volume-d24bae35-65ce-43a7-bcf0-676f17c00249 (d24bae35-65ce-43a7-bcf0-676f17c00249): created successfully Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3fe9be-965d-41f5-b419-e2672f3757cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Flow 'volume_create_manager' (dc169464-e8de-4c6a-89b9-f8c087937c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ad100627-0c46-4d1f-a9e6-1768d49f3540 tempest-VolumesListAdminTestJSON-312238572 None] Created volume successfully. Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Flow 'volume_create_manager' (0d50caa8-79c3-4c59-8d3f-713096f62502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51edceed-4de7-4045-8275-74ea71967b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51edceed-4de7-4045-8275-74ea71967b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1391995805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2696cc7d-1dc1-427b-948a-c897e25e494b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c296710904b2281c4fa84867d7287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:13Z,use_quota=True,user_id='57a6b78a8ce84d419140c7085e6cc1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3fd58a-2ca0-4332-b419-e8fc7c4e42a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3fd58a-2ca0-4332-b419-e8fc7c4e42a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5429fec5-1b10-4d18-9d36-49c31cc7c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5429fec5-1b10-4d18-9d36-49c31cc7c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2696cc7d-1dc1-427b-948a-c897e25e494b', 'volume_name': 'volume-2696cc7d-1dc1-427b-948a-c897e25e494b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccf78f0-d07d-4d49-adbe-5bd3f43d9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eccf78f0-d07d-4d49-adbe-5bd3f43d9fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4460d96-7b5e-4ad3-95ed-a37f2def1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Volume 2696cc7d-1dc1-427b-948a-c897e25e494b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2696cc7d-1dc1-427b-948a-c897e25e494b', 'volume_size': 1} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1391995805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2696cc7d-1dc1-427b-948a-c897e25e494b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='639c296710904b2281c4fa84867d7287',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:13Z,use_quota=True,user_id='57a6b78a8ce84d419140c7085e6cc1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Creating volume 2696cc7d-1dc1-427b-948a-c897e25e494b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:13 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:13 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b 1073741824 Aug 05 15:38:13 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:13 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b 1073741824" returned: 0 in 0.439s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:13 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b Aug 05 15:38:13 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:14 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b" returned: 0 in 0.259s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4460d96-7b5e-4ad3-95ed-a37f2def1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2696cc7d-1dc1-427b-948a-c897e25e494b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1ad2ba-5d27-43ed-a5b7-4ce1fa4435a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Volume volume-2696cc7d-1dc1-427b-948a-c897e25e494b (2696cc7d-1dc1-427b-948a-c897e25e494b): created successfully Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1ad2ba-5d27-43ed-a5b7-4ce1fa4435a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Flow 'volume_create_manager' (0d50caa8-79c3-4c59-8d3f-713096f62502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-15f195d2-1157-499e-896c-4051385ea0cc tempest-VolumesListAdminTestJSON-312238572 None] Created volume successfully. Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Flow 'volume_create_manager' (08e12e66-7c3a-43b9-bcb2-83fcceaff47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d33a97f-a87c-4871-8060-38bf425e8d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d33a97f-a87c-4871-8060-38bf425e8d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b9717f-cbd3-45a2-8776-5964aaa4ffb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af77a814d5c444881c8fc1923b6c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:16Z,use_quota=True,user_id='079f54f993a843988290afdc7b72e125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bb0325-9ce6-45ef-8cda-1011249091af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bb0325-9ce6-45ef-8cda-1011249091af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a2b53e-c718-4beb-82ee-453519743dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a2b53e-c718-4beb-82ee-453519743dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b9717f-cbd3-45a2-8776-5964aaa4ffb9', 'volume_name': 'volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464729af-5500-4749-b8fe-cfdd6c1a0171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464729af-5500-4749-b8fe-cfdd6c1a0171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a37d796-c5fa-41d9-9a07-d4d8418b1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:16 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Volume e4b9717f-cbd3-45a2-8776-5964aaa4ffb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9', 'volume_size': 1} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4b9717f-cbd3-45a2-8776-5964aaa4ffb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af77a814d5c444881c8fc1923b6c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:16Z,use_quota=True,user_id='079f54f993a843988290afdc7b72e125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Creating volume e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:16 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:16 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 1073741824 Aug 05 15:38:16 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:16 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 1073741824" returned: 0 in 0.417s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:16 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 Aug 05 15:38:16 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:16 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a37d796-c5fa-41d9-9a07-d4d8418b1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8d129b-eaa9-4726-8acb-bfbd54e58813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:16 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Volume volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 (e4b9717f-cbd3-45a2-8776-5964aaa4ffb9): created successfully Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8d129b-eaa9-4726-8acb-bfbd54e58813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Flow 'volume_create_manager' (08e12e66-7c3a-43b9-bcb2-83fcceaff47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-98981aa7-1d36-4cf5-81e1-6741387514c6 tempest-VolumesListAdminTestJSON-911218355 None] Created volume successfully. Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Acquiring lock "cinder-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Lock "cinder-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Acquiring lock "cinder-quobyte-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Lock "cinder-quobyte-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6358b84-d8b9-4104-92cd-c0b2a5d04c37]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "cinder-2696cc7d-1dc1-427b-948a-c897e25e494b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-2696cc7d-1dc1-427b-948a-c897e25e494b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "cinder-quobyte-2696cc7d-1dc1-427b-948a-c897e25e494b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:17 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 Aug 05 15:38:17 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-quobyte-2696cc7d-1dc1-427b-948a-c897e25e494b" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc6d285-2cad-4663-88d4-9b6f7cb266d6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:17 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b Aug 05 15:38:17 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:17 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:17 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9 Aug 05 15:38:17 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:17 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b" returned: 0 in 0.363s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:17 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b Aug 05 15:38:17 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:17 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9" returned: 0 in 0.251s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Lock "cinder-quobyte-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9" released by "delete_volume" :: held 0.661s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Created reservations ['b5f3e04c-03df-492f-8be5-0597427f8a3d', '70658125-e8c7-477f-b7ee-5a390335351f', '0455c0b7-416a-43ca-a9a5-9d76ce3e070d', '64324a19-bbe5-4091-adc4-d32fcd25b1b8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:17 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2696cc7d-1dc1-427b-948a-c897e25e494b" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:17 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:17 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-quobyte-2696cc7d-1dc1-427b-948a-c897e25e494b" released by "delete_volume" :: held 0.673s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Created reservations ['7c5ee929-9e98-4ed9-87ce-75582dccb17f', '6bb81c88-896f-4d1e-b4fc-f1e0fba5666e', 'ebd84dec-5dae-43b6-b807-3867c6c4fbeb', 'd9edbfba-4872-41fd-9258-11357bbd6ba1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:18 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:18 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:18 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.242s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Deleted volume successfully. Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-bcfaac06-668a-4c7c-8d98-fa0f48a97e76 tempest-VolumesListAdminTestJSON-911218355 None] Lock "cinder-e4b9717f-cbd3-45a2-8776-5964aaa4ffb9-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:18 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Deleted volume successfully. Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ea831d4-7cac-4d4b-b6de-ad81ecc5915d tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-2696cc7d-1dc1-427b-948a-c897e25e494b-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "cinder-d24bae35-65ce-43a7-bcf0-676f17c00249-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-d24bae35-65ce-43a7-bcf0-676f17c00249-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "cinder-quobyte-d24bae35-65ce-43a7-bcf0-676f17c00249" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-quobyte-d24bae35-65ce-43a7-bcf0-676f17c00249" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2e8fc-294b-4696-8aa0-dc48548c7981]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:18 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 Aug 05 15:38:18 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:18 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249" returned: 0 in 0.346s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:18 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249 Aug 05 15:38:18 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:19 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d24bae35-65ce-43a7-bcf0-676f17c00249" returned: 0 in 0.237s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-quobyte-d24bae35-65ce-43a7-bcf0-676f17c00249" released by "delete_volume" :: held 0.618s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Created reservations ['ac0baade-1a29-4905-82d4-739de6db6ce2', '16282d41-bfe7-4f90-937e-fbd86ff2fe74', '38ec484f-965b-4fb9-bc14-737140a0b2e6', '71c6afa0-1cc3-4cd7-ad3a-cbdb19b8b7d6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:19 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:19 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:19 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Deleted volume successfully. Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-24ce6407-6ae2-4058-ab47-269220762ddc tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-d24bae35-65ce-43a7-bcf0-676f17c00249-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "cinder-3c251533-f288-40a9-a6d1-fc0d358561a9-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-3c251533-f288-40a9-a6d1-fc0d358561a9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "cinder-quobyte-3c251533-f288-40a9-a6d1-fc0d358561a9" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-quobyte-3c251533-f288-40a9-a6d1-fc0d358561a9" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0fc1d-2cf7-48e8-849a-95298434b58d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Flow 'volume_create_manager' (48bbf40e-5c6b-4d68-809c-e8f212354871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d12f6-4efc-4fb5-971c-a401e7a21429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38d12f6-4efc-4fb5-971c-a401e7a21429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1610900923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e8e20c-f46d-4148-8ed4-3b1a87248f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedc21d703184029adc0e5df7b2efee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:20Z,use_quota=True,user_id='4a94bbc237884790bcbe339c1c497684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75424fd0-f103-4825-b6f2-34084d83e7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75424fd0-f103-4825-b6f2-34084d83e7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1febf306-0409-44dc-b8a9-20d0f8720820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:20 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 Aug 05 15:38:20 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1febf306-0409-44dc-b8a9-20d0f8720820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e8e20c-f46d-4148-8ed4-3b1a87248f46', 'volume_name': 'volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1bc111-44be-4351-b172-61d3de91a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1bc111-44be-4351-b172-61d3de91a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104bc444-aa75-445c-9f22-2b85833a8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Volume f2e8e20c-f46d-4148-8ed4-3b1a87248f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46', 'volume_size': 1} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1610900923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e8e20c-f46d-4148-8ed4-3b1a87248f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedc21d703184029adc0e5df7b2efee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:20Z,use_quota=True,user_id='4a94bbc237884790bcbe339c1c497684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Creating volume f2e8e20c-f46d-4148-8ed4-3b1a87248f46 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:20 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:20 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 1073741824 Aug 05 15:38:20 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:20 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9" returned: 0 in 0.451s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:20 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9 Aug 05 15:38:20 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:20 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 1073741824" returned: 0 in 0.464s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:20 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 Aug 05 15:38:20 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:20 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3c251533-f288-40a9-a6d1-fc0d358561a9" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-quobyte-3c251533-f288-40a9-a6d1-fc0d358561a9" released by "delete_volume" :: held 0.778s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Created reservations ['62a642d6-1a81-46b7-ac39-d0f1c8e6a01b', '8d822cf7-9b97-4572-8f7a-e8e102c8acf6', '8fdb8166-72d5-492f-807c-57ac21221687', '85671f29-5349-4067-94ad-1df96559b6c0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:20 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:20 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:20 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46" returned: 0 in 0.282s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (104bc444-aa75-445c-9f22-2b85833a8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399a7485-a7b1-4c51-92d0-35faf26e359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Volume volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 (f2e8e20c-f46d-4148-8ed4-3b1a87248f46): created successfully Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399a7485-a7b1-4c51-92d0-35faf26e359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Flow 'volume_create_manager' (48bbf40e-5c6b-4d68-809c-e8f212354871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-71b87405-ab74-4a6b-9274-bdcebad30c0b tempest-AttachVolumeTestJSON-1204103944 None] Created volume successfully. Aug 05 15:38:21 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.353s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:21 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Deleted volume successfully. Aug 05 15:38:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c116d22-08d5-40ec-b0ca-8d068060ec7f tempest-VolumesListAdminTestJSON-312238572 None] Lock "cinder-3c251533-f288-40a9-a6d1-fc0d358561a9-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-c544d66b-31ca-4ab3-95db-8eecde76f198 req-1bd03406-61f0-4629-bb74-12f9963d5126 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-c544d66b-31ca-4ab3-95db-8eecde76f198 req-1bd03406-61f0-4629-bb74-12f9963d5126 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-c544d66b-31ca-4ab3-95db-8eecde76f198 req-1bd03406-61f0-4629-bb74-12f9963d5126 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-c544d66b-31ca-4ab3-95db-8eecde76f198 req-1bd03406-61f0-4629-bb74-12f9963d5126 tempest-AttachVolumeTestJSON-1204103944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90bd3970-88fc-4fe0-a87f-a6616f7cd491', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:38:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-c544d66b-31ca-4ab3-95db-8eecde76f198 req-1bd03406-61f0-4629-bb74-12f9963d5126 tempest-AttachVolumeTestJSON-1204103944 None] attachment_update completed successfully. Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Flow 'volume_create_manager' (ce4265e0-2581-43f3-a4b3-8a9271b6da86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1772488-76be-4ab8-b2cb-ed988b079a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-de0b512f-9517-4f41-8f5a-0fba2bfd4f32 tempest-ServerActionsTestOtherA-6679622 None] Terminate volume connection completed successfully. Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-de0b512f-9517-4f41-8f5a-0fba2bfd4f32 tempest-ServerActionsTestOtherA-6679622 None] Deleting attachment 4efc027e-cc19-4cf2-9fbb-3ea4c7d3d490. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1772488-76be-4ab8-b2cb-ed988b079a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2092891051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedc21d703184029adc0e5df7b2efee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:26Z,use_quota=True,user_id='4a94bbc237884790bcbe339c1c497684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9987c2af-322e-4080-a5a6-5c198cad5e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9987c2af-322e-4080-a5a6-5c198cad5e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c257776e-eab6-4f34-9218-3014033682e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c257776e-eab6-4f34-9218-3014033682e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0', 'volume_name': 'volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1715e47-1d65-4fb9-83bb-cfd76991f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1715e47-1d65-4fb9-83bb-cfd76991f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e89e2d5-922b-43ee-bad6-1fad9452002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Volume 9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0', 'volume_size': 1} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2092891051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedc21d703184029adc0e5df7b2efee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:26Z,use_quota=True,user_id='4a94bbc237884790bcbe339c1c497684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Creating volume 9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:26 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:26 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 1073741824 Aug 05 15:38:26 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "cinder-f9f103c9-578c-4a7f-87d0-d1e4719b04cb-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-f9f103c9-578c-4a7f-87d0-d1e4719b04cb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "cinder-quobyte-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-quobyte-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[faabdf94-35b8-447d-9447-0a35b96b0266]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:26 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb Aug 05 15:38:26 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:27 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 1073741824" returned: 0 in 0.955s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:27 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 Aug 05 15:38:27 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:27 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" returned: 0 in 0.778s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:27 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb Aug 05 15:38:27 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:27 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "cinder-29c86d4e-c470-4d0d-be97-bc390a92dc72-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-29c86d4e-c470-4d0d-be97-bc390a92dc72-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e89e2d5-922b-43ee-bad6-1fad9452002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce10bd1-57d8-4eb8-8f7f-ab0857e2502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Volume volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 (9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0): created successfully Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce10bd1-57d8-4eb8-8f7f-ab0857e2502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Flow 'volume_create_manager' (ce4265e0-2581-43f3-a4b3-8a9271b6da86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Flow 'volume_create_manager' (3d2bdc32-1318-4a39-a641-4fd142b1a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:27 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa23464-f8e5-4555-ae71-edbd8d6a504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-da71a3fe-4a2e-4265-ab95-4a6ae1587b78 tempest-AttachVolumeTestJSON-1204103944 None] Created volume successfully. Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "cinder-quobyte-29c86d4e-c470-4d0d-be97-bc390a92dc72" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" returned: 0 in 0.480s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa23464-f8e5-4555-ae71-edbd8d6a504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1086660398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff170880-5397-448f-b580-e27684177896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbe847f79654559b7ca7ef878a0f339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:28Z,use_quota=True,user_id='8e1c2b8f3e464862a835e5b797493009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fb28be-d80e-4cc6-a546-9e97413003b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69fb28be-d80e-4cc6-a546-9e97413003b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f53554-0716-4725-9fc4-512e6d93ed82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28f53554-0716-4725-9fc4-512e6d93ed82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff170880-5397-448f-b580-e27684177896', 'volume_name': 'volume-ff170880-5397-448f-b580-e27684177896', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d782ba4a-6aa1-40f2-b4db-597ed3e7b055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d782ba4a-6aa1-40f2-b4db-597ed3e7b055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb9fe28-64d2-4c82-beca-281a0a45d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Volume ff170880-5397-448f-b580-e27684177896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff170880-5397-448f-b580-e27684177896', 'volume_size': 1} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1086660398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff170880-5397-448f-b580-e27684177896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbe847f79654559b7ca7ef878a0f339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:28Z,use_quota=True,user_id='8e1c2b8f3e464862a835e5b797493009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Creating volume ff170880-5397-448f-b580-e27684177896 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-quobyte-f9f103c9-578c-4a7f-87d0-d1e4719b04cb" released by "delete_volume" :: held 1.382s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-quobyte-29c86d4e-c470-4d0d-be97-bc390a92dc72" acquired by "delete_volume" :: waited 0.117s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:27 devstack sudo[95839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 1073741824 Aug 05 15:38:27 devstack sudo[95839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[19441cb5-9f9f-4e65-ae2b-e856efd99eb8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG cinder.quota [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Created reservations ['a1f09796-62c8-404c-a6d3-da46ec557896', '0aa2aa17-d30b-46b9-a8a6-318bf2689e71', '3d9fd10e-6603-4751-9da6-1b5e4336b763', '53c1ad4d-2edc-46c7-85e4-272c6e793718'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:28 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 Aug 05 15:38:28 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:28 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:28 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:28 devstack sudo[95839]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 1073741824" returned: 0 in 0.583s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:28 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72" returned: 0 in 0.559s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:28 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72 Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:28 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:28 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.485s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG cinder.manager [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:28 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 Aug 05 15:38:28 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Deleted volume successfully. Aug 05 15:38:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-821f45a6-04d1-4fc8-b787-dbaf89e3761c req-fcdd4a76-2c86-468b-85b9-80c6ce528042 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-f9f103c9-578c-4a7f-87d0-d1e4719b04cb-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:29 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb9fe28-64d2-4c82-beca-281a0a45d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff170880-5397-448f-b580-e27684177896', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daae21e-4d56-45a9-a8dd-f9a254046041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:29 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-29c86d4e-c470-4d0d-be97-bc390a92dc72" returned: 0 in 0.573s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:29 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Volume volume-ff170880-5397-448f-b580-e27684177896 (ff170880-5397-448f-b580-e27684177896): created successfully Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2daae21e-4d56-45a9-a8dd-f9a254046041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Flow 'volume_create_manager' (3d2bdc32-1318-4a39-a641-4fd142b1a773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-quobyte-29c86d4e-c470-4d0d-be97-bc390a92dc72" released by "delete_volume" :: held 1.198s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8001dc1b-9b98-4efd-9987-c9cd3c369361 tempest-SnapshotMetadataTestJSON-1099113675 None] Created volume successfully. Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Created reservations ['9068fdd6-140e-455c-9001-fc70a0854b64', '41e9ae4c-bf84-44dc-ba5c-d1483d128bac', '9b810977-b30a-4391-be9c-648ca1cb0a19', '5565cc69-5583-465c-bdc2-6e6b8ec81301'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:29 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:29 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-00fa1dba-f40d-462b-9db6-bc0168e82d96 req-a5202ca1-27be-4420-97b8-66b24d6e40c3 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-00fa1dba-f40d-462b-9db6-bc0168e82d96 req-a5202ca1-27be-4420-97b8-66b24d6e40c3 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-00fa1dba-f40d-462b-9db6-bc0168e82d96 req-a5202ca1-27be-4420-97b8-66b24d6e40c3 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-00fa1dba-f40d-462b-9db6-bc0168e82d96 req-a5202ca1-27be-4420-97b8-66b24d6e40c3 tempest-AttachVolumeTestJSON-1204103944 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad08290c-6473-47fc-8b56-6dd9d704c486', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:38:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-00fa1dba-f40d-462b-9db6-bc0168e82d96 req-a5202ca1-27be-4420-97b8-66b24d6e40c3 tempest-AttachVolumeTestJSON-1204103944 None] attachment_update completed successfully. Aug 05 15:38:29 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Deleted volume successfully. Aug 05 15:38:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9cc08f5-8224-4aa7-9891-be79bc0e15c7 tempest-ServerActionsTestOtherA-6679622 None] Lock "cinder-29c86d4e-c470-4d0d-be97-bc390a92dc72-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Creating offline snapshot 2018f49d-577c-424c-9cf2-5e038ac93d10 of volume ff170880-5397-448f-b580-e27684177896 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e91a0a-ee89-4a13-9b8b-48c947213f33]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:30 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 Aug 05 15:38:30 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:30 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896" returned: 0 in 0.481s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:30 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 1G Aug 05 15:38:30 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:31 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 1G" returned: 0 in 0.654s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff170880-5397-448f-b580-e27684177896 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:31 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff170880-5397-448f-b580-e27684177896 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 Aug 05 15:38:31 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:31 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff170880-5397-448f-b580-e27684177896 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10" returned: 0 in 0.535s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:31 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 is being set with open permissions: ugo+rw Aug 05 15:38:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:31 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 Aug 05 15:38:31 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:32 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10" returned: 0 in 0.446s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:32 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info Aug 05 15:38:32 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:32 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info" returned: 0 in 0.329s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:32 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info is being set with open permissions: ugo+rw Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:32 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info Aug 05 15:38:32 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:32 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.info" returned: 0 in 0.310s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.904s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-efc1dfb5-5884-4b2f-b7b2-c33d815d01f1 req-d5a36e29-142c-405e-95df-77d570b77d22 tempest-AttachVolumeTestJSON-1204103944 None] Terminate volume connection completed successfully. Aug 05 15:38:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-efc1dfb5-5884-4b2f-b7b2-c33d815d01f1 req-d5a36e29-142c-405e-95df-77d570b77d22 tempest-AttachVolumeTestJSON-1204103944 None] Deleting attachment 90bd3970-88fc-4fe0-a87f-a6616f7cd491. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:38:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-beb971a5-b06e-44f2-91ee-8a9efe77ec51 tempest-SnapshotMetadataTestJSON-1099113675 None] Create snapshot completed successfully Aug 05 15:38:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-527b2a84-3161-41f9-903a-25ff3126c4e0 req-a7dc5263-c046-41e5-9bcb-2b29d87b5a77 tempest-AttachVolumeNegativeTest-310103733 None] Terminate volume connection completed successfully. Aug 05 15:38:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-527b2a84-3161-41f9-903a-25ff3126c4e0 req-a7dc5263-c046-41e5-9bcb-2b29d87b5a77 tempest-AttachVolumeNegativeTest-310103733 None] Deleting attachment d97a0150-4b0c-42f8-94dc-187f5f3e7215. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "cinder-2018f49d-577c-424c-9cf2-5e038ac93d10-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-2018f49d-577c-424c-9cf2-5e038ac93d10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "cinder-quobyte-ff170880-5397-448f-b580-e27684177896" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-quobyte-ff170880-5397-448f-b580-e27684177896" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "cinder-quobyte-2018f49d-577c-424c-9cf2-5e038ac93d10" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-quobyte-2018f49d-577c-424c-9cf2-5e038ac93d10" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Deleting offline snapshot 2018f49d-577c-424c-9cf2-5e038ac93d10 of volume ff170880-5397-448f-b580-e27684177896 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] snapshot_file for this snap is: volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05cc6a-643f-4f8e-a886-298773948e84]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:34 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 Aug 05 15:38:34 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-819858a0-1b3c-40e1-89f9-e5d9ee5981c1 req-05802bce-ffad-4f04-8916-17ac1680acb8 tempest-AttachVolumeTestJSON-1204103944 None] Terminate volume connection completed successfully. Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-819858a0-1b3c-40e1-89f9-e5d9ee5981c1 req-05802bce-ffad-4f04-8916-17ac1680acb8 tempest-AttachVolumeTestJSON-1204103944 None] Deleting attachment ad08290c-6473-47fc-8b56-6dd9d704c486. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:38:34 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10" returned: 0 in 0.546s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff170880-5397-448f-b580-e27684177896(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81286cb-66c2-48f4-bd8a-ca5fd7f49c47]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:35 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 Aug 05 15:38:35 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:35 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896" returned: 0 in 0.669s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:35 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 Aug 05 15:38:35 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:36 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10" returned: 0 in 0.507s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:36 devstack sudo[96018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10 Aug 05 15:38:36 devstack sudo[96018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:36 devstack sudo[96018]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896.2018f49d-577c-424c-9cf2-5e038ac93d10" returned: 0 in 0.343s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-quobyte-2018f49d-577c-424c-9cf2-5e038ac93d10" released by "_delete_snapshot" :: held 2.233s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-quobyte-ff170880-5397-448f-b580-e27684177896" released by "delete_snapshot" :: held 2.273s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Created reservations ['5466e27e-33a0-4212-b04e-85c2592efb68', 'c906d4f0-9ab1-46a0-a93f-c50f3fcc2e69', '436ba87c-1f3e-489f-9dad-48229ddbd6c8', 'a7933641-9704-488b-a882-6fe13b8c4550'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Delete snapshot completed successfully. Aug 05 15:38:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d670754-4971-40ec-8530-49be3f398524 tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-2018f49d-577c-424c-9cf2-5e038ac93d10-delete_snapshot" released by "delete_snapshot" :: held 2.650s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "cinder-ff170880-5397-448f-b580-e27684177896-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-ff170880-5397-448f-b580-e27684177896-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "cinder-quobyte-ff170880-5397-448f-b580-e27684177896" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-quobyte-ff170880-5397-448f-b580-e27684177896" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e4ef0-5535-45f9-a814-f75723d39743]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:37 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 Aug 05 15:38:37 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:38 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896" returned: 0 in 0.467s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:38 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896 Aug 05 15:38:38 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:38 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff170880-5397-448f-b580-e27684177896" returned: 0 in 0.373s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-quobyte-ff170880-5397-448f-b580-e27684177896" released by "delete_volume" :: held 0.927s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Created reservations ['4979d24d-4df1-4442-bb65-deaecc9815d9', '43e8a337-ea99-4d91-96a5-5b884123c795', '66475e50-ea60-4ec9-84ca-0ce964014477', 'e36a8ba2-9978-4a8f-85c1-f71da0b2a353'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:38 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:38 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:39 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:39 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Deleted volume successfully. Aug 05 15:38:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0f7a3c9-2b25-402c-963a-a89e33caed9e tempest-SnapshotMetadataTestJSON-1099113675 None] Lock "cinder-ff170880-5397-448f-b580-e27684177896-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "cinder-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "cinder-quobyte-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-quobyte-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73c6079-85bd-4347-8cd0-995c0fefe7e5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:41 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 Aug 05 15:38:41 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:42 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0" returned: 0 in 0.578s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:42 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0 Aug 05 15:38:42 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:42 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0" returned: 0 in 0.268s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-quobyte-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0" released by "delete_volume" :: held 0.893s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Created reservations ['39bb32c2-8914-44b2-bf07-aaf3cd3c9262', 'ea7ecdc3-a787-4815-b46c-130235e62faf', 'ec0061b5-ba1b-4a39-8bba-74cf69eb3a70', '963cbbab-5dd1-4729-abb2-5950d2c0d470'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:42 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:42 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "cinder-f2e8e20c-f46d-4148-8ed4-3b1a87248f46-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-f2e8e20c-f46d-4148-8ed4-3b1a87248f46-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "cinder-quobyte-f2e8e20c-f46d-4148-8ed4-3b1a87248f46" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-quobyte-f2e8e20c-f46d-4148-8ed4-3b1a87248f46" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe56de6-60b0-4119-a871-a206c7115d11]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:43 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 Aug 05 15:38:43 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:43 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.459s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:43 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Deleted volume successfully. Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a0c9e3f4-b742-4bfd-b044-2e73f4871a2f tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-9e07dc9e-7a2a-4da9-b843-08f75bf1bbd0-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:43 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46" returned: 0 in 0.462s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:43 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46 Aug 05 15:38:43 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:43 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2e8e20c-f46d-4148-8ed4-3b1a87248f46" returned: 0 in 0.315s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-quobyte-f2e8e20c-f46d-4148-8ed4-3b1a87248f46" released by "delete_volume" :: held 0.840s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Created reservations ['da950163-e203-4f51-912b-a08eb478ae84', 'aa94132f-bbed-4c03-87eb-d3be821b10fd', '443c6877-462d-4250-894b-cd7aac51d600', '764a2fe3-48b8-4754-9460-18d527df70c8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:43 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:43 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "cinder-e17721d9-440a-4365-a609-7221e7f426d7-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-e17721d9-440a-4365-a609-7221e7f426d7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "cinder-quobyte-e17721d9-440a-4365-a609-7221e7f426d7" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-quobyte-e17721d9-440a-4365-a609-7221e7f426d7" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40295d4-dbc2-41fd-900c-c80fbd96ad6b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:44 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.455s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Deleted volume successfully. Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0802e230-4df6-46b1-8e0f-9ca676c9049a tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-f2e8e20c-f46d-4148-8ed4-3b1a87248f46-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:44 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 Aug 05 15:38:44 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:44 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7" returned: 0 in 0.493s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:44 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7 Aug 05 15:38:44 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:45 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e17721d9-440a-4365-a609-7221e7f426d7" returned: 0 in 0.302s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-quobyte-e17721d9-440a-4365-a609-7221e7f426d7" released by "delete_volume" :: held 0.854s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Created reservations ['302db445-3e52-41d2-a3f7-2ae279f90829', '65b8bc9a-7357-4b1b-b865-a0ae46928de5', '557a8334-e90d-4048-a633-611b63b45132', 'b9fcd597-e52f-409b-9835-87b86072fd2c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:45 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:45 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:45 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.321s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Deleted volume successfully. Aug 05 15:38:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c5a63ad4-d393-4822-960b-21db43595329 tempest-AttachVolumeTestJSON-1204103944 None] Lock "cinder-e17721d9-440a-4365-a609-7221e7f426d7-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Flow 'volume_create_manager' (1f451e16-516e-4b9b-8694-ec27fa9d5db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1d0d2c-0caa-4bf2-8046-3049914c8555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1d0d2c-0caa-4bf2-8046-3049914c8555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1674372393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33b676e-43d9-4120-8b34-99055cc86ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52da2b7480a4b02ba31343e2fe7d87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:46Z,use_quota=True,user_id='6e71be6ba0ff45789596b8cc6ab2f150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52eec285-e7ce-4bc2-9c51-3a74b0a20ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52eec285-e7ce-4bc2-9c51-3a74b0a20ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a1d30d-5cc0-4193-85a2-e8018f58fb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a1d30d-5cc0-4193-85a2-e8018f58fb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33b676e-43d9-4120-8b34-99055cc86ef4', 'volume_name': 'volume-d33b676e-43d9-4120-8b34-99055cc86ef4', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764e44a6-76a2-4884-aa6a-3885d2ebc409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (764e44a6-76a2-4884-aa6a-3885d2ebc409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74491fa4-6c55-42bb-8046-a03b4e7c0621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:46 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Volume d33b676e-43d9-4120-8b34-99055cc86ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33b676e-43d9-4120-8b34-99055cc86ef4', 'volume_size': 1} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1674372393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33b676e-43d9-4120-8b34-99055cc86ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d52da2b7480a4b02ba31343e2fe7d87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:38:46Z,use_quota=True,user_id='6e71be6ba0ff45789596b8cc6ab2f150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Creating volume d33b676e-43d9-4120-8b34-99055cc86ef4 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:46 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:46 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 1073741824 Aug 05 15:38:46 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:46 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 1073741824" returned: 0 in 0.560s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:47 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 Aug 05 15:38:47 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:47 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4" returned: 0 in 0.284s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74491fa4-6c55-42bb-8046-a03b4e7c0621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33b676e-43d9-4120-8b34-99055cc86ef4', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b34bef-abf3-4e14-8828-1b70a8d88e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Volume volume-d33b676e-43d9-4120-8b34-99055cc86ef4 (d33b676e-43d9-4120-8b34-99055cc86ef4): created successfully Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b34bef-abf3-4e14-8828-1b70a8d88e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Flow 'volume_create_manager' (1f451e16-516e-4b9b-8694-ec27fa9d5db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-dceefc78-8a95-433f-ba88-31e5656f6cc6 tempest-AbsoluteLimitsTests-1906628695 None] Created volume successfully. Aug 05 15:38:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Acquiring lock "cinder-d33b676e-43d9-4120-8b34-99055cc86ef4-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Lock "cinder-d33b676e-43d9-4120-8b34-99055cc86ef4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Acquiring lock "cinder-quobyte-d33b676e-43d9-4120-8b34-99055cc86ef4" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:38:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Lock "cinder-quobyte-d33b676e-43d9-4120-8b34-99055cc86ef4" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:38:48 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97d261a-4ac4-407f-98e8-b68f02fe71e3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:38:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:48 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 Aug 05 15:38:48 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:49 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4" returned: 0 in 0.441s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:49 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4 Aug 05 15:38:49 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:49 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d33b676e-43d9-4120-8b34-99055cc86ef4" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Lock "cinder-quobyte-d33b676e-43d9-4120-8b34-99055cc86ef4" released by "delete_volume" :: held 0.742s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Created reservations ['e3d39a79-f5af-499f-9009-9d2ed9d87b6a', 'acb2c68e-bd0a-469f-9b7a-cc5c58f7c45e', 'd46842d5-2aa8-46b0-82c0-c8fb95e9316c', '3df3632b-6c67-4181-b0e1-918ad02b1995'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:49 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:38:49 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:38:49 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:38:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Deleted volume successfully. Aug 05 15:38:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb414b5c-8958-4a45-acc8-1991cb337e0e tempest-AbsoluteLimitsTests-1906628695 None] Lock "cinder-d33b676e-43d9-4120-8b34-99055cc86ef4-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=115,cinder:SELECT=104,cinder:INSERT=36,cinder:DELETE=9 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Flow 'volume_create_manager' (60006344-3827-4d39-93bf-974a6dfa1394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ae17f7-a94c-4c30-a4c0-a28bc8fd0ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ae17f7-a94c-4c30-a4c0-a28bc8fd0ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-402820492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd54ae73-42a1-4bf3-9d52-a808e407302b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcb2d9a32341c1b5b9cc66958f22ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:00Z,use_quota=True,user_id='152ddcf0ff5446eb8bdef409ca00b8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ed195d-f394-46fe-a750-9acdf530a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ed195d-f394-46fe-a750-9acdf530a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704c9281-dcdf-412a-8013-8c08a83b4a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704c9281-dcdf-412a-8013-8c08a83b4a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd54ae73-42a1-4bf3-9d52-a808e407302b', 'volume_name': 'volume-bd54ae73-42a1-4bf3-9d52-a808e407302b', 'volume_size': 2}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d1397d-ee14-4560-9d57-dea76308cd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d1397d-ee14-4560-9d57-dea76308cd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202fa08e-1580-4c56-aec4-81c2f567ac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:38:59 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Volume bd54ae73-42a1-4bf3-9d52-a808e407302b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd54ae73-42a1-4bf3-9d52-a808e407302b', 'volume_size': 2} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-402820492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd54ae73-42a1-4bf3-9d52-a808e407302b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcb2d9a32341c1b5b9cc66958f22ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:00Z,use_quota=True,user_id='152ddcf0ff5446eb8bdef409ca00b8db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Creating volume bd54ae73-42a1-4bf3-9d52-a808e407302b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:38:59 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:38:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b 2147483648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:38:59 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b 2147483648 Aug 05 15:38:59 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:00 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b 2147483648" returned: 0 in 0.872s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:00 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b Aug 05 15:39:00 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:01 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b" returned: 0 in 0.404s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202fa08e-1580-4c56-aec4-81c2f567ac5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd54ae73-42a1-4bf3-9d52-a808e407302b', 'volume_size': 2}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d05954f-ec5d-4baa-add0-138e8ca78be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:01 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Volume volume-bd54ae73-42a1-4bf3-9d52-a808e407302b (bd54ae73-42a1-4bf3-9d52-a808e407302b): created successfully Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d05954f-ec5d-4baa-add0-138e8ca78be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Flow 'volume_create_manager' (60006344-3827-4d39-93bf-974a6dfa1394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c1fec565-7026-4f7d-b207-602f19175a8e tempest-VolumesCloneNegativeTest-306022988 None] Created volume successfully. Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Flow 'volume_create_manager' (ead9346e-1f1a-4fb7-bc95-40a2450f3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02037db9-c1cf-4fdd-b12e-83324d97b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02037db9-c1cf-4fdd-b12e-83324d97b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1272171711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9953206d-3de3-4c6d-bb37-1752a9c60186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c124458be2a04ce492b0f2c2893d6e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:01Z,use_quota=True,user_id='167f0f5309114fd98a7ca7a44ee46a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d25660-ad16-4e61-b150-72fd310bcd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d25660-ad16-4e61-b150-72fd310bcd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276b9125-be2a-4acb-a1e6-8298d9c8013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276b9125-be2a-4acb-a1e6-8298d9c8013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9953206d-3de3-4c6d-bb37-1752a9c60186', 'volume_name': 'volume-9953206d-3de3-4c6d-bb37-1752a9c60186', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0204fba0-6b14-46d5-9a74-103c4569d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0204fba0-6b14-46d5-9a74-103c4569d27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f872aeb4-62f2-46f1-a1b7-50fa2e73b168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:01 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Volume 9953206d-3de3-4c6d-bb37-1752a9c60186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9953206d-3de3-4c6d-bb37-1752a9c60186', 'volume_size': 1} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1272171711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9953206d-3de3-4c6d-bb37-1752a9c60186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c124458be2a04ce492b0f2c2893d6e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:01Z,use_quota=True,user_id='167f0f5309114fd98a7ca7a44ee46a6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Creating volume 9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:39:01 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:39:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:01 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 1073741824 Aug 05 15:39:01 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Acquiring lock "cinder-bd54ae73-42a1-4bf3-9d52-a808e407302b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Lock "cinder-bd54ae73-42a1-4bf3-9d52-a808e407302b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Acquiring lock "cinder-quobyte-bd54ae73-42a1-4bf3-9d52-a808e407302b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Lock "cinder-quobyte-bd54ae73-42a1-4bf3-9d52-a808e407302b" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:02 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 1073741824" returned: 0 in 0.822s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3050699-d44e-4f7e-a309-9de5f7a20557]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:02 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 Aug 05 15:39:02 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:02 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b Aug 05 15:39:02 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:02 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186" returned: 0 in 0.362s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f872aeb4-62f2-46f1-a1b7-50fa2e73b168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9953206d-3de3-4c6d-bb37-1752a9c60186', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b35437f-9b91-42b7-8f4c-e405ae1d94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:02 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Volume volume-9953206d-3de3-4c6d-bb37-1752a9c60186 (9953206d-3de3-4c6d-bb37-1752a9c60186): created successfully Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b35437f-9b91-42b7-8f4c-e405ae1d94d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Flow 'volume_create_manager' (ead9346e-1f1a-4fb7-bc95-40a2450f3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:02 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-1632362d-9c30-40c1-9d93-6a920c086084 req-56e66607-5df8-4fda-8ba1-0f53c4c340e1 tempest-VolumesSnapshotsTestJSON-228748682 None] Created volume successfully. Aug 05 15:39:03 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b" returned: 0 in 0.793s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:03 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b Aug 05 15:39:03 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:03 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bd54ae73-42a1-4bf3-9d52-a808e407302b" returned: 0 in 0.405s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Lock "cinder-quobyte-bd54ae73-42a1-4bf3-9d52-a808e407302b" released by "delete_volume" :: held 1.291s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Created reservations ['0c4508ff-ee91-4907-93ef-953b05f69212', '87708f9d-1e50-4254-ab12-bc1670c9be38', '22c86b16-3f24-438e-bd8f-95d00b7a76be', '55d6170a-4cc7-4c7b-a0eb-85cff324b1c1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:03 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:39:03 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:04 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.445s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:39:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Deleted volume successfully. Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Creating offline snapshot 8bc66b8b-44b9-4773-a7c1-4812c6e0d648 of volume 9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c2b7979-e73f-4d76-a28d-295472d97295 tempest-VolumesCloneNegativeTest-306022988 None] Lock "cinder-bd54ae73-42a1-4bf3-9d52-a808e407302b-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[09484c03-a9cd-42f0-97b1-d17e45e06650]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:04 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 Aug 05 15:39:04 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:05 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186" returned: 0 in 0.698s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:05 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 1G Aug 05 15:39:05 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:06 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 1G" returned: 0 in 0.884s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9953206d-3de3-4c6d-bb37-1752a9c60186 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:06 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9953206d-3de3-4c6d-bb37-1752a9c60186 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 Aug 05 15:39:06 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:06 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9953206d-3de3-4c6d-bb37-1752a9c60186 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648" returned: 0 in 0.490s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:06 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 is being set with open permissions: ugo+rw Aug 05 15:39:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:06 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 Aug 05 15:39:06 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:07 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648" returned: 0 in 0.434s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=101,cinder:UPDATE=143,cinder:DELETE=12,cinder:INSERT=25 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:07 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info Aug 05 15:39:07 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:07 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info" returned: 0 in 0.322s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:07 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info is being set with open permissions: ugo+rw Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:07 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info Aug 05 15:39:07 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:07 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.info" returned: 0 in 0.314s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.404s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-7a8ec0c3-1356-428f-a4b3-c0b0031a45b4 req-78a993ec-54b0-4a5b-8a69-f6fd978faef7 tempest-VolumesSnapshotsTestJSON-228748682 None] Create snapshot completed successfully Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "cinder-8bc66b8b-44b9-4773-a7c1-4812c6e0d648-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-8bc66b8b-44b9-4773-a7c1-4812c6e0d648-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "cinder-quobyte-9953206d-3de3-4c6d-bb37-1752a9c60186" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-quobyte-9953206d-3de3-4c6d-bb37-1752a9c60186" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "cinder-quobyte-8bc66b8b-44b9-4773-a7c1-4812c6e0d648" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-quobyte-8bc66b8b-44b9-4773-a7c1-4812c6e0d648" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Deleting offline snapshot 8bc66b8b-44b9-4773-a7c1-4812c6e0d648 of volume 9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] snapshot_file for this snap is: volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[881f9165-13de-4c9f-a699-c74fdb784c4f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:08 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 Aug 05 15:39:08 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:09 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648" returned: 0 in 0.890s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9953206d-3de3-4c6d-bb37-1752a9c60186(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:39:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc0128-0473-4b0b-aa7a-7a018eb9a750]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:09 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 Aug 05 15:39:09 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:10 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:39:10 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:10 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186" returned: 0 in 0.957s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:10 devstack sudo[96416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 Aug 05 15:39:10 devstack sudo[96416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:10 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.754s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:39:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:39:11 devstack sudo[96416]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648" returned: 0 in 0.648s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:11 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648 Aug 05 15:39:11 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:11 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186.8bc66b8b-44b9-4773-a7c1-4812c6e0d648" returned: 0 in 0.447s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-quobyte-8bc66b8b-44b9-4773-a7c1-4812c6e0d648" released by "_delete_snapshot" :: held 3.142s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-quobyte-9953206d-3de3-4c6d-bb37-1752a9c60186" released by "delete_snapshot" :: held 3.186s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG cinder.quota [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Created reservations ['750a700a-7b8c-483b-99c3-9fb8d1879c60', '591b759e-0793-429e-988a-643c086a6560', '92136d4b-288b-427d-825f-31ab66810b40', '4fb1fb08-19ba-413a-ad2a-2afcf0c04411'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:39:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Delete snapshot completed successfully. Aug 05 15:39:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-8c764790-0740-4d40-a751-831369e6a941 req-21f5a7fa-bfc7-42c9-8e49-e61d2d15f838 tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-8bc66b8b-44b9-4773-a7c1-4812c6e0d648-delete_snapshot" released by "delete_snapshot" :: held 3.384s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "cinder-9953206d-3de3-4c6d-bb37-1752a9c60186-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-9953206d-3de3-4c6d-bb37-1752a9c60186-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "cinder-quobyte-9953206d-3de3-4c6d-bb37-1752a9c60186" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-quobyte-9953206d-3de3-4c6d-bb37-1752a9c60186" acquired by "delete_volume" :: waited 0.058s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b6e58-5d10-4735-9c5a-55fc26efd4ff]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:12 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 Aug 05 15:39:12 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:13 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186" returned: 0 in 0.813s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:13 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186 Aug 05 15:39:13 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:13 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9953206d-3de3-4c6d-bb37-1752a9c60186" returned: 0 in 0.378s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-quobyte-9953206d-3de3-4c6d-bb37-1752a9c60186" released by "delete_volume" :: held 1.287s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG cinder.quota [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Created reservations ['5657cf9b-3296-470d-ad6e-f9b2b1945e71', '1874c757-3443-48f9-abeb-b6a1f471d01d', '927cfad9-706c-417d-b400-e2478c78a0ad', '077e9e9e-56e6-4d95-b261-33971bdfee8d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:13 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:39:13 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:14 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:14 devstack cinder-volume[88999]: DEBUG cinder.manager [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:39:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Deleted volume successfully. Aug 05 15:39:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-1d1576ea-4380-4d1f-a211-0a54e3ad5aa4 req-5b33ad83-2bbb-4d0c-8ef4-67c6fd483d1e tempest-VolumesSnapshotsTestJSON-228748682 None] Lock "cinder-9953206d-3de3-4c6d-bb37-1752a9c60186-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Flow 'volume_create_manager' (9d2fdc09-96b5-4dae-b55e-073999e1653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5943bef-20b1-4a23-b661-00bb80ae5e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5943bef-20b1-4a23-b661-00bb80ae5e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-765379143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a651ce-4161-424a-9a39-5e0a8c4e1e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c28ea541af4e93af70296f357ec286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:24Z,use_quota=True,user_id='7f783f227cd945ee9e3729c348f1a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbedfc7-3232-4cfb-b9c9-648979060fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbedfc7-3232-4cfb-b9c9-648979060fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213357a2-1e58-4ea6-bce9-bef4112d4ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (213357a2-1e58-4ea6-bce9-bef4112d4ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22a651ce-4161-424a-9a39-5e0a8c4e1e17', 'volume_name': 'volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9385b84-4d04-4b06-be80-72e32e218ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9385b84-4d04-4b06-be80-72e32e218ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcb2159-170a-4ff9-b5a8-31d342c77b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:23 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Volume 22a651ce-4161-424a-9a39-5e0a8c4e1e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17', 'volume_size': 1} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-765379143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22a651ce-4161-424a-9a39-5e0a8c4e1e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c28ea541af4e93af70296f357ec286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:24Z,use_quota=True,user_id='7f783f227cd945ee9e3729c348f1a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Creating volume 22a651ce-4161-424a-9a39-5e0a8c4e1e17 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:39:23 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:39:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:23 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 1073741824 Aug 05 15:39:23 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:24 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 1073741824" returned: 0 in 0.670s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:24 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 Aug 05 15:39:24 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:24 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcb2159-170a-4ff9-b5a8-31d342c77b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a912c25f-77aa-4177-8a07-d6c3b3b0c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:24 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Volume volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 (22a651ce-4161-424a-9a39-5e0a8c4e1e17): created successfully Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a912c25f-77aa-4177-8a07-d6c3b3b0c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Flow 'volume_create_manager' (9d2fdc09-96b5-4dae-b55e-073999e1653b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:24 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-64d7b0f9-2673-4e9d-a333-7a49eeb9db8f tempest-AttachVolumeNegativeTest-310103733 None] Created volume successfully. Aug 05 15:39:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-aec4ff7d-b60f-4699-a14a-b51b20335dd2 req-dfb357e5-0937-4b2a-a535-a34877cb98be tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-aec4ff7d-b60f-4699-a14a-b51b20335dd2 req-dfb357e5-0937-4b2a-a535-a34877cb98be tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-aec4ff7d-b60f-4699-a14a-b51b20335dd2 req-dfb357e5-0937-4b2a-a535-a34877cb98be tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-aec4ff7d-b60f-4699-a14a-b51b20335dd2 req-dfb357e5-0937-4b2a-a535-a34877cb98be tempest-AttachVolumeNegativeTest-310103733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fb29b44-f513-4010-b1af-717c853b0ff0', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:39:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-aec4ff7d-b60f-4699-a14a-b51b20335dd2 req-dfb357e5-0937-4b2a-a535-a34877cb98be tempest-AttachVolumeNegativeTest-310103733 None] attachment_update completed successfully. Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (0b019ee7-4bd4-42ab-8987-b86480671c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d11fa1-3d4d-4c7f-bbb7-537509f42b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d11fa1-3d4d-4c7f-bbb7-537509f42b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2068933960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6796f268-707f-4b4f-97a7-dc5e397b8d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:28Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49955b33-a3de-46d6-b9df-cc2af139896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49955b33-a3de-46d6-b9df-cc2af139896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34771771-10ca-4427-b0a7-dca660e19606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34771771-10ca-4427-b0a7-dca660e19606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6796f268-707f-4b4f-97a7-dc5e397b8d22', 'volume_name': 'volume-6796f268-707f-4b4f-97a7-dc5e397b8d22', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72886f35-3832-470b-af6e-4cb6173c7749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72886f35-3832-470b-af6e-4cb6173c7749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d392828d-c6d5-4022-8458-2e6c8e1cbcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Volume 6796f268-707f-4b4f-97a7-dc5e397b8d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6796f268-707f-4b4f-97a7-dc5e397b8d22', 'volume_size': 1} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2068933960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6796f268-707f-4b4f-97a7-dc5e397b8d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:28Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Creating volume 6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:39:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:39:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:27 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 1073741824 Aug 05 15:39:27 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:28 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 1073741824" returned: 0 in 0.542s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:28 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 Aug 05 15:39:28 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:28 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22" returned: 0 in 0.295s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d392828d-c6d5-4022-8458-2e6c8e1cbcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6796f268-707f-4b4f-97a7-dc5e397b8d22', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067452c2-f71e-447f-a140-34e318ea37dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Volume volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 (6796f268-707f-4b4f-97a7-dc5e397b8d22): created successfully Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067452c2-f71e-447f-a140-34e318ea37dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (0b019ee7-4bd4-42ab-8987-b86480671c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8dd5819b-d4d1-4c03-a29c-691f4b0ff34d tempest-VolumesSnapshotTestJSON-1823684016 None] Created volume successfully. Aug 05 15:39:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-ade0df0d-3df5-4d90-8fd5-7761fe3f89d8 req-ecfdfd3c-d7be-4efb-8c9b-90154c4d17ad tempest-AttachVolumeNegativeTest-310103733 None] Terminate volume connection completed successfully. Aug 05 15:39:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-ade0df0d-3df5-4d90-8fd5-7761fe3f89d8 req-ecfdfd3c-d7be-4efb-8c9b-90154c4d17ad tempest-AttachVolumeNegativeTest-310103733 None] Deleting attachment 0fb29b44-f513-4010-b1af-717c853b0ff0. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Creating offline snapshot 4a37703a-70b7-4c85-a5e0-23fdf8e0c292 of volume 6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[74958d6c-897f-44db-a256-cbf9fc7f5070]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:30 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 Aug 05 15:39:30 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:30 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22" returned: 0 in 0.377s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:30 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 1G Aug 05 15:39:30 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:31 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 1G" returned: 0 in 0.554s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:31 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 Aug 05 15:39:31 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:31 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292" returned: 0 in 0.620s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:31 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 is being set with open permissions: ugo+rw Aug 05 15:39:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:31 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 Aug 05 15:39:31 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:32 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292" returned: 0 in 0.387s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:32 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info Aug 05 15:39:32 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:32 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info" returned: 0 in 0.401s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:32 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info is being set with open permissions: ugo+rw Aug 05 15:39:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:32 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info Aug 05 15:39:32 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:32 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.info" returned: 0 in 0.375s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cdf10c96-3a61-43bd-a915-7344022b599d tempest-VolumesSnapshotTestJSON-1823684016 None] Create snapshot completed successfully Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-4a37703a-70b7-4c85-a5e0-23fdf8e0c292-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-4a37703a-70b7-4c85-a5e0-23fdf8e0c292-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-6796f268-707f-4b4f-97a7-dc5e397b8d22" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-6796f268-707f-4b4f-97a7-dc5e397b8d22" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-4a37703a-70b7-4c85-a5e0-23fdf8e0c292" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-4a37703a-70b7-4c85-a5e0-23fdf8e0c292" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Deleting offline snapshot 4a37703a-70b7-4c85-a5e0-23fdf8e0c292 of volume 6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] snapshot_file for this snap is: volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd975d-71aa-48a7-b783-15c7239e1714]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:33 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 Aug 05 15:39:33 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:34 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292" returned: 0 in 0.528s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6796f268-707f-4b4f-97a7-dc5e397b8d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:39:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[345f7d9e-03a3-4e0d-83b2-538db33614ef]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:34 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 Aug 05 15:39:34 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:34 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22" returned: 0 in 0.415s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:34 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 Aug 05 15:39:34 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:35 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292" returned: 0 in 0.443s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:35 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292 Aug 05 15:39:35 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:35 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22.4a37703a-70b7-4c85-a5e0-23fdf8e0c292" returned: 0 in 0.306s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-4a37703a-70b7-4c85-a5e0-23fdf8e0c292" released by "_delete_snapshot" :: held 1.809s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-6796f268-707f-4b4f-97a7-dc5e397b8d22" released by "delete_snapshot" :: held 1.840s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['e9a378f9-d160-42c1-9974-2d1f5e91051a', '1ca046b6-0772-436b-a012-58c3f7692d21', 'e290c0cf-0e7a-490f-88e4-6eebcff0e94e', '73617c74-0b78-4ca4-9de0-6c5b5cc28c45'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:39:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Delete snapshot completed successfully. Aug 05 15:39:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-18bd7135-15e1-443f-80c6-4f443321ef40 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-4a37703a-70b7-4c85-a5e0-23fdf8e0c292-delete_snapshot" released by "delete_snapshot" :: held 2.107s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:36 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Flow 'volume_create_manager' (c2a140d8-a2f0-47d2-bc1d-ada432c845cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a935ff-0b8e-4ceb-91b2-1720b6421312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90a935ff-0b8e-4ceb-91b2-1720b6421312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-678200690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf848bf-a4ec-42ef-8b15-b5990061b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b217b13e73452485cc61ff3c284d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:37Z,use_quota=True,user_id='446e00aadec544c69789d4d036bfc912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83059288-5998-4d67-bdc8-981c471f15f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83059288-5998-4d67-bdc8-981c471f15f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f14ccb0-782d-42f2-a3a3-b686df50c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f14ccb0-782d-42f2-a3a3-b686df50c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf848bf-a4ec-42ef-8b15-b5990061b071', 'volume_name': 'volume-bcf848bf-a4ec-42ef-8b15-b5990061b071', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b710db-e7c7-497b-8eca-822e98956a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58b710db-e7c7-497b-8eca-822e98956a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4b03b4-3758-4d60-8c88-d5f250b6af71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Volume bcf848bf-a4ec-42ef-8b15-b5990061b071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf848bf-a4ec-42ef-8b15-b5990061b071', 'volume_size': 1} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-678200690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf848bf-a4ec-42ef-8b15-b5990061b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b217b13e73452485cc61ff3c284d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:37Z,use_quota=True,user_id='446e00aadec544c69789d4d036bfc912',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Creating volume bcf848bf-a4ec-42ef-8b15-b5990061b071 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:39:37 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:39:37 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 1073741824 Aug 05 15:39:37 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (069b2e22-123c-4762-9ab3-5e8f969d82ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ce4839-4d92-4f90-b7fa-eb2c64ce54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ce4839-4d92-4f90-b7fa-eb2c64ce54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-294896806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb18087-ce3b-4822-8121-e478b9edbd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:37Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3ccda9-bb2f-4402-83eb-f29809332288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e3ccda9-bb2f-4402-83eb-f29809332288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cc7bf8-8b26-4aa4-baa8-f31b73e27953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34cc7bf8-8b26-4aa4-baa8-f31b73e27953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb18087-ce3b-4822-8121-e478b9edbd55', 'volume_name': 'volume-ecb18087-ce3b-4822-8121-e478b9edbd55', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52aea28-935c-4b18-8728-12fe8219861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52aea28-935c-4b18-8728-12fe8219861f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a92a0f-2517-4b1c-a326-a883e146be95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:37 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Volume ecb18087-ce3b-4822-8121-e478b9edbd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb18087-ce3b-4822-8121-e478b9edbd55', 'volume_size': 1} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:37 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 1073741824" returned: 0 in 0.580s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:37 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 Aug 05 15:39:37 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:38 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-294896806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb18087-ce3b-4822-8121-e478b9edbd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:37Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Creating volume ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:39:38 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4b03b4-3758-4d60-8c88-d5f250b6af71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf848bf-a4ec-42ef-8b15-b5990061b071', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66e1652-dc2c-4d24-abca-15c03579bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:38 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 1073741824 Aug 05 15:39:38 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Volume volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 (bcf848bf-a4ec-42ef-8b15-b5990061b071): created successfully Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a66e1652-dc2c-4d24-abca-15c03579bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Flow 'volume_create_manager' (c2a140d8-a2f0-47d2-bc1d-ada432c845cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ed5f5d90-4d34-4505-8ea3-d856e56bc49c tempest-AttachVolumeShelveTestJSON-1072210182 None] Created volume successfully. Aug 05 15:39:38 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 1073741824" returned: 0 in 0.490s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:38 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 Aug 05 15:39:38 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:38 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55" returned: 0 in 0.310s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a92a0f-2517-4b1c-a326-a883e146be95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb18087-ce3b-4822-8121-e478b9edbd55', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726bfc48-975d-4617-ad0d-9caa212903d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Volume volume-ecb18087-ce3b-4822-8121-e478b9edbd55 (ecb18087-ce3b-4822-8121-e478b9edbd55): created successfully Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (726bfc48-975d-4617-ad0d-9caa212903d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (069b2e22-123c-4762-9ab3-5e8f969d82ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-30a4cda6-4b90-41b2-bd98-fa098b5c1034 tempest-VolumesSnapshotTestJSON-1823684016 None] Created volume successfully. Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Creating offline snapshot 7037f014-6e50-4971-a1e0-f06f0e1fb5c1 of volume ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ace6d6-509a-41b0-a94c-b3590b3a2299]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:40 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 Aug 05 15:39:40 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:40 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55" returned: 0 in 0.406s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:40 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 1G Aug 05 15:39:40 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:41 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 1G" returned: 0 in 0.664s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb18087-ce3b-4822-8121-e478b9edbd55 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:41 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb18087-ce3b-4822-8121-e478b9edbd55 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 Aug 05 15:39:41 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:41 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecb18087-ce3b-4822-8121-e478b9edbd55 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1" returned: 0 in 0.488s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:41 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 is being set with open permissions: ugo+rw Aug 05 15:39:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:41 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 Aug 05 15:39:41 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:42 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1" returned: 0 in 0.313s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:42 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info Aug 05 15:39:42 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:42 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info" returned: 0 in 0.481s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:42 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info is being set with open permissions: ugo+rw Aug 05 15:39:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:42 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info Aug 05 15:39:42 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:42 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.info" returned: 0 in 0.323s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.865s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:43 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5f7efe57-3438-402d-8e4a-52e10d42ea2b tempest-VolumesSnapshotTestJSON-1823684016 None] Create snapshot completed successfully Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (6cdec3c3-1bc2-4f70-9eb5-7efc1d31a2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d062e8-b6f2-4081-a4ba-b509ba3a081c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d062e8-b6f2-4081-a4ba-b509ba3a081c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-544649318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:39:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=7037f014-6e50-4971-a1e0-f06f0e1fb5c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:39:44Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2763665c-c073-4a61-afa6-fe4e790f8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2763665c-c073-4a61-afa6-fe4e790f8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bf76da-bc67-4e87-abeb-c07d8d7db67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bf76da-bc67-4e87-abeb-c07d8d7db67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6', 'volume_name': 'volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6', 'volume_size': 2, 'snapshot_id': '7037f014-6e50-4971-a1e0-f06f0e1fb5c1'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbee1f48-ed01-4adf-b33c-477afc774b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbee1f48-ed01-4adf-b33c-477afc774b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb14662-8b39-4434-bbf5-ec6e03082b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:44 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Volume 9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6', 'volume_size': 2, 'snapshot_id': '7037f014-6e50-4971-a1e0-f06f0e1fb5c1'} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-7037f014-6e50-4971-a1e0-f06f0e1fb5c1-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-7037f014-6e50-4971-a1e0-f06f0e1fb5c1-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Creating volume 9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 from snapshot 7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] snapshot: 7037f014-6e50-4971-a1e0-f06f0e1fb5c1, volume: 9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9465d2-8ede-4b7e-8346-227485c887cf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:44 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 Aug 05 15:39:44 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:45 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1" returned: 0 in 0.651s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb18087-ce3b-4822-8121-e478b9edbd55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:39:45 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6830e2-24a5-438d-8d79-bdd405817472]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:45 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 Aug 05 15:39:45 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:46 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55" returned: 0 in 0.760s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:39:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:39:46 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:39:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:46 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 Aug 05 15:39:46 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:54 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=12,cinder:UPDATE=37 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:39:54 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:54 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=54,cinder:SELECT=67,cinder:DELETE=5,cinder:INSERT=9 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:39:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" returned: 0 in 8.428s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:54 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:39:54 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Converted 1024.00 MB image at 121.48 MB/s Aug 05 15:39:54 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 is being set with open permissions: ugo+rw Aug 05 15:39:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:54 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 Aug 05 15:39:54 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:55 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" returned: 0 in 0.539s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" released by "_copy_volume_from_snapshot" :: held 10.600s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-7037f014-6e50-4971-a1e0-f06f0e1fb5c1-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" released by "_create_volume_from_snapshot" :: held 10.719s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.750s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bb14662-8b39-4434-bbf5-ec6e03082b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6', 'volume_size': 2, 'snapshot_id': '7037f014-6e50-4971-a1e0-f06f0e1fb5c1'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6a2275-7c51-4800-acb8-8adca7c1d642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:39:55 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Volume volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 (9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6): created successfully Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6a2275-7c51-4800-acb8-8adca7c1d642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:39:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (6cdec3c3-1bc2-4f70-9eb5-7efc1d31a2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:39:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e1ddaf52-7e26-4e84-bec7-6a40669a260e tempest-VolumesSnapshotTestJSON-1823684016 None] Created volume successfully. Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" acquired by "delete_volume" :: waited 0.039s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec174d4b-27be-4e74-9582-bc7b8f955ef7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:56 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 Aug 05 15:39:56 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-2dafdd7a-a0b6-4328-b4da-e168a5f5087f req-a1e7ae9d-3884-451a-a3bf-de65037f71b7 tempest-AttachVolumeShelveTestJSON-1072210182 None] No connector for attachment 87d63e2b-7703-4def-9190-40b7bffa59a2; skipping storage backend terminate_connection call. {{(pid=88999) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 05 15:39:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-2dafdd7a-a0b6-4328-b4da-e168a5f5087f req-a1e7ae9d-3884-451a-a3bf-de65037f71b7 tempest-AttachVolumeShelveTestJSON-1072210182 None] Deleting attachment 87d63e2b-7703-4def-9190-40b7bffa59a2. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:39:57 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" returned: 0 in 0.618s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:57 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6 Aug 05 15:39:57 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:57 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" returned: 0 in 0.453s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6" released by "delete_volume" :: held 1.172s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['57c00774-ceba-4e5a-ab4a-6b1aab60866e', '86ac44ff-1ebd-4656-af42-4b873298b62f', '9aca651d-1504-4ba5-8a14-27a44a00068e', '05f6a46e-0aae-4286-b283-46ef47e3acb6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:39:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:57 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:39:57 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:58 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:39:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Deleted volume successfully. Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89d92fec-37a1-4f15-9c9c-5cbfd658a047 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-9ddf05b7-d60e-49b8-9ab5-bf2f837a6eb6-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-7037f014-6e50-4971-a1e0-f06f0e1fb5c1-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-7037f014-6e50-4971-a1e0-f06f0e1fb5c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-ecb18087-ce3b-4822-8121-e478b9edbd55" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-ecb18087-ce3b-4822-8121-e478b9edbd55" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-7037f014-6e50-4971-a1e0-f06f0e1fb5c1" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-7037f014-6e50-4971-a1e0-f06f0e1fb5c1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Deleting offline snapshot 7037f014-6e50-4971-a1e0-f06f0e1fb5c1 of volume ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] snapshot_file for this snap is: volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f67a28c-b223-4e73-b3c4-07649705fe47]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:59 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 Aug 05 15:39:59 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:39:59 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Aug 05 15:39:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1" returned: 0 in 0.596s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:39:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecb18087-ce3b-4822-8121-e478b9edbd55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:39:59 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[635e3bd1-fc89-4c7a-b708-44a2c1a0dd2d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:39:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:39:59 devstack sudo[97301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 Aug 05 15:39:59 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:00 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55" returned: 0 in 0.689s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:00 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 Aug 05 15:40:00 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:00 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1" returned: 0 in 0.569s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:00 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1 Aug 05 15:40:00 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:01 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55.7037f014-6e50-4971-a1e0-f06f0e1fb5c1" returned: 0 in 0.510s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-7037f014-6e50-4971-a1e0-f06f0e1fb5c1" released by "_delete_snapshot" :: held 2.541s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-ecb18087-ce3b-4822-8121-e478b9edbd55" released by "delete_snapshot" :: held 2.578s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:01 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['30658780-ad8d-4b82-a5c0-3901926f7910', '16046ea9-3f2c-4ff3-af1e-9fbfd3d46a0a', '338e2876-e41a-4788-921e-8a228a243a85', '7b5f2390-f308-4dec-b861-65b3e71923d5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Delete snapshot completed successfully. Aug 05 15:40:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-69e36e70-b3e5-41c7-b3f8-ae43fcf41528 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-7037f014-6e50-4971-a1e0-f06f0e1fb5c1-delete_snapshot" released by "delete_snapshot" :: held 2.810s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-ecb18087-ce3b-4822-8121-e478b9edbd55-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-ecb18087-ce3b-4822-8121-e478b9edbd55-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-ecb18087-ce3b-4822-8121-e478b9edbd55" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-ecb18087-ce3b-4822-8121-e478b9edbd55" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[66407ff0-ee79-46ca-911f-aacabecdec6b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:02 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 Aug 05 15:40:02 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:03 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55" returned: 0 in 0.723s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:03 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55 Aug 05 15:40:03 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:03 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecb18087-ce3b-4822-8121-e478b9edbd55" returned: 0 in 0.411s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-ecb18087-ce3b-4822-8121-e478b9edbd55" released by "delete_volume" :: held 1.268s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['6f46e799-f26a-4e5e-a8a1-e11d80ea8989', 'bf7062a4-c7a4-4549-8b82-95fa18013e23', '62d8d803-6073-4aa2-b77d-92c0672d37d7', '5f260b1d-7dfb-4b0b-bceb-e4bed445a0d8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:03 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:03 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:04 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.310s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:04 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Deleted volume successfully. Aug 05 15:40:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3987c430-8e75-49ad-8d79-a1998b214d03 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-ecb18087-ce3b-4822-8121-e478b9edbd55-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (69db0866-3407-4a09-95f4-0adfe8ef8520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f13820-96d8-42ed-8f66-61d61fbdc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f13820-96d8-42ed-8f66-61d61fbdc3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1364564668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56f6bde-e83a-4030-ba96-09e9d63be380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:05Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4691b650-d42f-4a5d-8f67-3909f17fa9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4691b650-d42f-4a5d-8f67-3909f17fa9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c4daea-abb8-4aa7-a755-8169240317f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c4daea-abb8-4aa7-a755-8169240317f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56f6bde-e83a-4030-ba96-09e9d63be380', 'volume_name': 'volume-d56f6bde-e83a-4030-ba96-09e9d63be380', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbebae39-1a2e-4dcc-b2f0-b646b5c9089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbebae39-1a2e-4dcc-b2f0-b646b5c9089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecda64ea-6fb0-423e-b6a1-e5180ad95096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:05 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Volume d56f6bde-e83a-4030-ba96-09e9d63be380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56f6bde-e83a-4030-ba96-09e9d63be380', 'volume_size': 1} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1364564668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56f6bde-e83a-4030-ba96-09e9d63be380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:05Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Creating volume d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:05 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:05 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 1073741824 Aug 05 15:40:05 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:05 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 1073741824" returned: 0 in 0.524s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:05 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 Aug 05 15:40:05 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:06 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecda64ea-6fb0-423e-b6a1-e5180ad95096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56f6bde-e83a-4030-ba96-09e9d63be380', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955eaa1f-400a-48a5-bfef-91b50fe9b29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Volume volume-d56f6bde-e83a-4030-ba96-09e9d63be380 (d56f6bde-e83a-4030-ba96-09e9d63be380): created successfully Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955eaa1f-400a-48a5-bfef-91b50fe9b29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (69db0866-3407-4a09-95f4-0adfe8ef8520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:06 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-29cd4e08-16cc-45e7-8742-f5692dc87ae6 tempest-VolumesSnapshotTestJSON-1823684016 None] Created volume successfully. Aug 05 15:40:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Creating offline snapshot 030400c9-cd9b-48be-ae54-c57ff2d67491 of volume d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:40:07 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aa3916-3d4f-4e80-93e9-86cc993ee4fe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:07 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 Aug 05 15:40:07 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:08 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380" returned: 0 in 0.532s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:08 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 1G Aug 05 15:40:08 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:08 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 1G" returned: 0 in 0.684s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56f6bde-e83a-4030-ba96-09e9d63be380 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:08 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56f6bde-e83a-4030-ba96-09e9d63be380 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 Aug 05 15:40:08 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:09 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56f6bde-e83a-4030-ba96-09e9d63be380 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491" returned: 0 in 0.465s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:09 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 is being set with open permissions: ugo+rw Aug 05 15:40:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:09 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 Aug 05 15:40:09 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:09 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:09 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info Aug 05 15:40:09 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:09 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info" returned: 0 in 0.308s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:09 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info is being set with open permissions: ugo+rw Aug 05 15:40:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:09 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info Aug 05 15:40:09 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:10 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.info" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:10 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:10 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-109ca4fb-bfa5-4252-8f25-57343a5f7c33 tempest-VolumesSnapshotTestJSON-1823684016 None] Create snapshot completed successfully Aug 05 15:40:10 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.424s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:40:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (6a0b4271-d1ca-4ef0-943f-35a43ade690b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833fcdff-fddb-4db4-8a2a-c5f277c8d914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833fcdff-fddb-4db4-8a2a-c5f277c8d914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1162839058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2657947-57b4-45a4-b5b1-e5992e38bee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d438c3d56c0f49219f86c1fb2a7cb6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=030400c9-cd9b-48be-ae54-c57ff2d67491,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:12Z,use_quota=True,user_id='fab1fec78ab2446084452d9d9f296b6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4560914a-549b-4441-a165-e126653b0c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4560914a-549b-4441-a165-e126653b0c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e10059-23e2-4cca-bef8-608ad6d4e558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e10059-23e2-4cca-bef8-608ad6d4e558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2657947-57b4-45a4-b5b1-e5992e38bee2', 'volume_name': 'volume-c2657947-57b4-45a4-b5b1-e5992e38bee2', 'volume_size': 1, 'snapshot_id': '030400c9-cd9b-48be-ae54-c57ff2d67491'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93cfd0-3b89-4872-94e2-d578d64cb689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d93cfd0-3b89-4872-94e2-d578d64cb689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df4533a-6520-4e09-b519-7d9f2f954247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Volume c2657947-57b4-45a4-b5b1-e5992e38bee2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2657947-57b4-45a4-b5b1-e5992e38bee2', 'volume_size': 1, 'snapshot_id': '030400c9-cd9b-48be-ae54-c57ff2d67491'} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-030400c9-cd9b-48be-ae54-c57ff2d67491-c2657947-57b4-45a4-b5b1-e5992e38bee2" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-030400c9-cd9b-48be-ae54-c57ff2d67491-c2657947-57b4-45a4-b5b1-e5992e38bee2" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Creating volume c2657947-57b4-45a4-b5b1-e5992e38bee2 from snapshot 030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-c2657947-57b4-45a4-b5b1-e5992e38bee2" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-c2657947-57b4-45a4-b5b1-e5992e38bee2" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] snapshot: 030400c9-cd9b-48be-ae54-c57ff2d67491, volume: c2657947-57b4-45a4-b5b1-e5992e38bee2, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fce0fe-fa8c-45e4-875b-c74330c7ae92]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:12 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 Aug 05 15:40:12 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:12 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491" returned: 0 in 0.434s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56f6bde-e83a-4030-ba96-09e9d63be380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d74780-3280-4827-ba50-74b7ae5f1862]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:12 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 Aug 05 15:40:12 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:12 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380" returned: 0 in 0.427s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:40:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:12 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 Aug 05 15:40:12 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:15 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Flow 'volume_create_manager' (4aadf3eb-4ecc-4169-82b1-2c86d94b5393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec57ccdc-da0f-45fb-b2c0-bc7b18791717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec57ccdc-da0f-45fb-b2c0-bc7b18791717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1998146994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcf46c2-eb83-4939-8586-5a5015866903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab8d0e2b95149b8997d7676c05967c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:16Z,use_quota=True,user_id='669b30e29a894e76a0795750f9861556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79e0b6c-96b4-464b-9778-80430834ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79e0b6c-96b4-464b-9778-80430834ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfc1c4c-8595-47ea-941a-f2f0a7338a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebfc1c4c-8595-47ea-941a-f2f0a7338a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fcf46c2-eb83-4939-8586-5a5015866903', 'volume_name': 'volume-6fcf46c2-eb83-4939-8586-5a5015866903', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf94f53-3e0d-4517-85ae-9a57d951040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf94f53-3e0d-4517-85ae-9a57d951040b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970b63c9-f100-4cf3-9015-74cd805f21f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:16 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Volume 6fcf46c2-eb83-4939-8586-5a5015866903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fcf46c2-eb83-4939-8586-5a5015866903', 'volume_size': 1} Aug 05 15:40:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Flow 'volume_create_manager' (23acd077-816c-4949-acdd-3db02197cbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1beb02d-af68-4125-86ef-ef09f69ea1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1beb02d-af68-4125-86ef-ef09f69ea1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-145400293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641f3cc0-1677-4c88-9635-85d50fe84988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c28ea541af4e93af70296f357ec286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:18Z,use_quota=True,user_id='7f783f227cd945ee9e3729c348f1a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a691c354-519c-49ec-b9b2-f1276e0dcef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a691c354-519c-49ec-b9b2-f1276e0dcef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf2caaf-f8dc-430b-947a-a9cfc066424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf2caaf-f8dc-430b-947a-a9cfc066424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641f3cc0-1677-4c88-9635-85d50fe84988', 'volume_name': 'volume-641f3cc0-1677-4c88-9635-85d50fe84988', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22db434c-f501-4c7b-9f18-30be37341d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22db434c-f501-4c7b-9f18-30be37341d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f0d3d6-9e7c-42ff-9169-63d7e1563c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:18 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Volume 641f3cc0-1677-4c88-9635-85d50fe84988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641f3cc0-1677-4c88-9635-85d50fe84988', 'volume_size': 1} Aug 05 15:40:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:19 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2" returned: 0 in 6.202s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:40:19 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Converted 1024.00 MB image at 165.08 MB/s Aug 05 15:40:19 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 is being set with open permissions: ugo+rw Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:19 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 Aug 05 15:40:19 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:19 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-c2657947-57b4-45a4-b5b1-e5992e38bee2" released by "_copy_volume_from_snapshot" :: held 7.441s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-030400c9-cd9b-48be-ae54-c57ff2d67491-c2657947-57b4-45a4-b5b1-e5992e38bee2" released by "_create_volume_from_snapshot" :: held 7.518s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.538s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1998146994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fcf46c2-eb83-4939-8586-5a5015866903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ab8d0e2b95149b8997d7676c05967c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:16Z,use_quota=True,user_id='669b30e29a894e76a0795750f9861556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Creating volume 6fcf46c2-eb83-4939-8586-5a5015866903 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:19 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df4533a-6520-4e09-b519-7d9f2f954247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2657947-57b4-45a4-b5b1-e5992e38bee2', 'volume_size': 1, 'snapshot_id': '030400c9-cd9b-48be-ae54-c57ff2d67491'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:19 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 1073741824 Aug 05 15:40:19 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081391e4-8e3b-4674-a890-ee07f74eeb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:19 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Volume volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 (c2657947-57b4-45a4-b5b1-e5992e38bee2): created successfully Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (081391e4-8e3b-4674-a890-ee07f74eeb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Flow 'volume_create_manager' (6a0b4271-d1ca-4ef0-943f-35a43ade690b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-50e1aaa2-fbc2-4c0a-8c54-ff8ef1d3e3fc tempest-VolumesSnapshotTestJSON-1823684016 None] Created volume successfully. Aug 05 15:40:19 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 1073741824" returned: 0 in 0.495s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-c2657947-57b4-45a4-b5b1-e5992e38bee2-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-c2657947-57b4-45a4-b5b1-e5992e38bee2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-c2657947-57b4-45a4-b5b1-e5992e38bee2" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:20 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 Aug 05 15:40:20 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-c2657947-57b4-45a4-b5b1-e5992e38bee2" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea1941c-d0c3-475c-83df-77be3f768025]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:20 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 Aug 05 15:40:20 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:20 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-145400293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641f3cc0-1677-4c88-9635-85d50fe84988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42c28ea541af4e93af70296f357ec286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:18Z,use_quota=True,user_id='7f783f227cd945ee9e3729c348f1a59b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Creating volume 641f3cc0-1677-4c88-9635-85d50fe84988 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:20 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970b63c9-f100-4cf3-9015-74cd805f21f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fcf46c2-eb83-4939-8586-5a5015866903', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa50c51-9be3-42d3-be6d-c8cfe50abf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:20 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 1073741824 Aug 05 15:40:20 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Volume volume-6fcf46c2-eb83-4939-8586-5a5015866903 (6fcf46c2-eb83-4939-8586-5a5015866903): created successfully Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa50c51-9be3-42d3-be6d-c8cfe50abf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Flow 'volume_create_manager' (4aadf3eb-4ecc-4169-82b1-2c86d94b5393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-afd3990d-32c3-4fe9-a159-2b01b942dc2e tempest-VolumesServicesTestJSON-1545325976 None] Created volume successfully. Aug 05 15:40:20 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2" returned: 0 in 0.413s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:20 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2 Aug 05 15:40:20 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:20 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-c2657947-57b4-45a4-b5b1-e5992e38bee2" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-c2657947-57b4-45a4-b5b1-e5992e38bee2" released by "delete_volume" :: held 0.759s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:20 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 1073741824" returned: 0 in 0.497s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['820924f5-ab02-497b-b6a0-512b2809d31a', 'd2632c90-e3b1-4e00-b1f1-a46689dfb65a', 'efbdfae6-cd65-468a-b4a5-eb8829218dc5', '53a49132-ba86-42de-8431-0e7292acea34'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:20 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 Aug 05 15:40:20 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:20 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:21 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:21 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f0d3d6-9e7c-42ff-9169-63d7e1563c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641f3cc0-1677-4c88-9635-85d50fe84988', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d487f560-5dbc-4f3f-8cde-925e5d0d8914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-030400c9-cd9b-48be-ae54-c57ff2d67491-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:21 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Volume volume-641f3cc0-1677-4c88-9635-85d50fe84988 (641f3cc0-1677-4c88-9635-85d50fe84988): created successfully Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d487f560-5dbc-4f3f-8cde-925e5d0d8914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Flow 'volume_create_manager' (23acd077-816c-4949-acdd-3db02197cbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:21 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-030400c9-cd9b-48be-ae54-c57ff2d67491-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-d56f6bde-e83a-4030-ba96-09e9d63be380" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.448s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Deleted volume successfully. Aug 05 15:40:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9df75317-7b7d-4e68-b8dc-aa6cfec5ebb5 tempest-AttachVolumeNegativeTest-310103733 None] Created volume successfully. Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-d56f6bde-e83a-4030-ba96-09e9d63be380" acquired by "delete_snapshot" :: waited 0.047s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-030400c9-cd9b-48be-ae54-c57ff2d67491" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ef6bfc7f-76f3-4c9f-af5f-d3a2f53462f4 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-c2657947-57b4-45a4-b5b1-e5992e38bee2-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Acquiring lock "cinder-6fcf46c2-eb83-4939-8586-5a5015866903-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-030400c9-cd9b-48be-ae54-c57ff2d67491" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Deleting offline snapshot 030400c9-cd9b-48be-ae54-c57ff2d67491 of volume d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] snapshot_file for this snap is: volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Lock "cinder-6fcf46c2-eb83-4939-8586-5a5015866903-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bbdf6a-78fd-490b-a62b-680da9b21a0c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Acquiring lock "cinder-quobyte-6fcf46c2-eb83-4939-8586-5a5015866903" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Lock "cinder-quobyte-6fcf46c2-eb83-4939-8586-5a5015866903" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1332bcf-a85b-4475-809c-300103942559]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:21 devstack sudo[97611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 Aug 05 15:40:21 devstack sudo[97611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:21 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 Aug 05 15:40:21 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:21 devstack sudo[97611]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491" returned: 0 in 0.409s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56f6bde-e83a-4030-ba96-09e9d63be380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[84baa34c-18ac-4777-a6cd-71de07e99c10]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:22 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903" returned: 0 in 0.387s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:22 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903 Aug 05 15:40:22 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:22 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 Aug 05 15:40:22 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:22 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6fcf46c2-eb83-4939-8586-5a5015866903" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Lock "cinder-quobyte-6fcf46c2-eb83-4939-8586-5a5015866903" released by "delete_volume" :: held 0.717s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Created reservations ['e70ec633-0d9e-4b4f-befc-441a4caeba1d', 'a92827e5-5128-43f5-ae50-7055381a3f46', 'c1a7928a-a547-4879-9e09-42e6df4e5d71', '21013a2d-9d13-4c32-baba-10d2e615c1b6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:22 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:22 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:22 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380" returned: 0 in 0.614s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:22 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 Aug 05 15:40:22 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:22 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.435s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:22 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Deleted volume successfully. Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0d8671d-2de5-41a3-abe1-ce0ea41f11ef tempest-VolumesServicesTestJSON-1545325976 None] Lock "cinder-6fcf46c2-eb83-4939-8586-5a5015866903-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:23 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491" returned: 0 in 0.539s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:23 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491 Aug 05 15:40:23 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:23 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380.030400c9-cd9b-48be-ae54-c57ff2d67491" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-030400c9-cd9b-48be-ae54-c57ff2d67491" released by "_delete_snapshot" :: held 2.035s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-d56f6bde-e83a-4030-ba96-09e9d63be380" released by "delete_snapshot" :: held 2.098s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-ac6bdc0e-7f52-41b9-8d85-127235a90f8f req-66b55c32-0d3c-46e4-8e30-6dc40f0529ca tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-ac6bdc0e-7f52-41b9-8d85-127235a90f8f req-66b55c32-0d3c-46e4-8e30-6dc40f0529ca tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-ac6bdc0e-7f52-41b9-8d85-127235a90f8f req-66b55c32-0d3c-46e4-8e30-6dc40f0529ca tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['7d6e543f-0a72-4e8b-8ae8-ddcf645a3cff', 'd9f687e6-aa8c-4f9d-a1d8-05454ce39bfe', 'b35f7390-8fee-408f-b52c-0005f55d91c1', 'b4a2a1d1-40aa-47f9-a6fb-5fec69173b6a'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-ac6bdc0e-7f52-41b9-8d85-127235a90f8f req-66b55c32-0d3c-46e4-8e30-6dc40f0529ca tempest-AttachVolumeNegativeTest-310103733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-641f3cc0-1677-4c88-9635-85d50fe84988', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2b5a762-4cdc-445e-bd1f-6d2aba4fd72a', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:40:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-ac6bdc0e-7f52-41b9-8d85-127235a90f8f req-66b55c32-0d3c-46e4-8e30-6dc40f0529ca tempest-AttachVolumeNegativeTest-310103733 None] attachment_update completed successfully. Aug 05 15:40:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Delete snapshot completed successfully. Aug 05 15:40:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d6ae39a5-c2c3-4d8a-b9b8-8fe2f382de30 tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-030400c9-cd9b-48be-ae54-c57ff2d67491-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-d56f6bde-e83a-4030-ba96-09e9d63be380-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-d56f6bde-e83a-4030-ba96-09e9d63be380-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-d56f6bde-e83a-4030-ba96-09e9d63be380" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-d56f6bde-e83a-4030-ba96-09e9d63be380" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f4a06e-69fd-44b5-98ba-c9199c88a0c1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:24 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 Aug 05 15:40:24 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:25 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:25 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380 Aug 05 15:40:25 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:25 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d56f6bde-e83a-4030-ba96-09e9d63be380" returned: 0 in 0.269s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-d56f6bde-e83a-4030-ba96-09e9d63be380" released by "delete_volume" :: held 0.750s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['5e0dcca7-f329-4b3e-b4cc-da1d43c6790e', 'dd227fc8-a272-4bc5-86f7-764ffa8e259d', '3b8a817e-ca58-4245-a20c-3795e93372b0', 'b213bbd8-e4ad-4da0-8c99-eff740b49e39'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:25 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:25 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-6796f268-707f-4b4f-97a7-dc5e397b8d22-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-6796f268-707f-4b4f-97a7-dc5e397b8d22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:26 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.409s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Deleted volume successfully. Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "cinder-quobyte-6796f268-707f-4b4f-97a7-dc5e397b8d22" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-6796f268-707f-4b4f-97a7-dc5e397b8d22" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-631b2c94-8aa5-4b4d-bb4d-dbe9218df1ff tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-d56f6bde-e83a-4030-ba96-09e9d63be380-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e7da39-d13c-4c47-bbed-46ed9fd59b29]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:26 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 Aug 05 15:40:26 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:26 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22" returned: 0 in 0.410s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-6293cd54-15d8-40be-ba65-fd021eac5db9 req-3cd0844c-8d0f-49c1-bb00-8c39072ee101 tempest-AttachVolumeNegativeTest-310103733 None] Terminate volume connection completed successfully. Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-6293cd54-15d8-40be-ba65-fd021eac5db9 req-3cd0844c-8d0f-49c1-bb00-8c39072ee101 tempest-AttachVolumeNegativeTest-310103733 None] Deleting attachment c2b5a762-4cdc-445e-bd1f-6d2aba4fd72a. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:40:26 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22 Aug 05 15:40:26 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:26 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6796f268-707f-4b4f-97a7-dc5e397b8d22" returned: 0 in 0.295s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-quobyte-6796f268-707f-4b4f-97a7-dc5e397b8d22" released by "delete_volume" :: held 0.773s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:26 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Created reservations ['e3577bd6-60fb-4bbb-92de-a1ef2656c1ed', 'c4e415f3-b440-47eb-978f-c9bd844964e0', 'a55f4963-0047-4adf-a442-94b94c255bfa', 'd9412689-591f-44b1-b4d0-62f0cfb59291'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:27 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:27 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:27 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.291s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Deleted volume successfully. Aug 05 15:40:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df85148a-2168-4ce7-961d-071413d800eb tempest-VolumesSnapshotTestJSON-1823684016 None] Lock "cinder-6796f268-707f-4b4f-97a7-dc5e397b8d22-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Flow 'volume_create_manager' (9501b3d3-b210-44cc-a7a5-80b5f8ce1b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cb6c2f-5d55-48a7-b9a4-ba2139723284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cb6c2f-5d55-48a7-b9a4-ba2139723284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-607505397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b38a447-6f39-4daa-b367-0c8628a8c68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af566a87926414ab9688f1b68657ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:32Z,use_quota=True,user_id='26a83e916b0742b6a56c4fab2b4f64a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b952b645-d97f-4556-8983-c3f7270d0a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b952b645-d97f-4556-8983-c3f7270d0a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d3e1ed-aeb7-4deb-ad81-2c8fcfa104f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d3e1ed-aeb7-4deb-ad81-2c8fcfa104f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b38a447-6f39-4daa-b367-0c8628a8c68f', 'volume_name': 'volume-1b38a447-6f39-4daa-b367-0c8628a8c68f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63296772-5db1-4180-b8b9-096f897613ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63296772-5db1-4180-b8b9-096f897613ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6923c9ae-cfc0-4abe-b655-7b67c001adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Volume 1b38a447-6f39-4daa-b367-0c8628a8c68f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b38a447-6f39-4daa-b367-0c8628a8c68f', 'volume_size': 1} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-607505397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b38a447-6f39-4daa-b367-0c8628a8c68f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af566a87926414ab9688f1b68657ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:32Z,use_quota=True,user_id='26a83e916b0742b6a56c4fab2b4f64a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Creating volume 1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:31 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:31 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f 1073741824 Aug 05 15:40:31 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "cinder-641f3cc0-1677-4c88-9635-85d50fe84988-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-641f3cc0-1677-4c88-9635-85d50fe84988-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:32 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f 1073741824" returned: 0 in 0.818s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "cinder-quobyte-641f3cc0-1677-4c88-9635-85d50fe84988" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-quobyte-641f3cc0-1677-4c88-9635-85d50fe84988" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9baaf2c-41f2-4752-988d-6bf013b6cb9a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:32 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:32 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:32 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 Aug 05 15:40:32 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:33 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.459s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6923c9ae-cfc0-4abe-b655-7b67c001adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b38a447-6f39-4daa-b367-0c8628a8c68f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be6f762-c323-4b36-b891-76b8508aa906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Volume volume-1b38a447-6f39-4daa-b367-0c8628a8c68f (1b38a447-6f39-4daa-b367-0c8628a8c68f): created successfully Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2be6f762-c323-4b36-b891-76b8508aa906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Flow 'volume_create_manager' (9501b3d3-b210-44cc-a7a5-80b5f8ce1b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-df41ea46-a2f0-403f-a2ad-da0e43a36a56 tempest-VolumesDeleteCascade-1868710621 None] Created volume successfully. Aug 05 15:40:33 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988" returned: 0 in 0.723s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:33 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988 Aug 05 15:40:33 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:33 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-641f3cc0-1677-4c88-9635-85d50fe84988" returned: 0 in 0.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-quobyte-641f3cc0-1677-4c88-9635-85d50fe84988" released by "delete_volume" :: held 1.201s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Created reservations ['c8eca59b-8307-4e8d-9e78-f97a48b7f2ee', 'a83e4e42-031d-4f64-9e02-d7db8b192833', '71eff8a1-b52d-4471-8ba1-97cf230f6f8a', 'dcc387a6-e675-4f3c-8f3e-cbc2eb10130d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:34 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:34 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Creating offline snapshot 945d83ce-4504-4642-8676-1ada163d0e63 of volume 1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[add98550-9712-4007-a8ae-0a854a5ddf53]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:34 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Deleted volume successfully. Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b23becf7-2038-4b96-b042-299df7c10f3e tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-641f3cc0-1677-4c88-9635-85d50fe84988-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:34 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:34 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:34 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.521s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:34 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 1G Aug 05 15:40:34 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "cinder-22a651ce-4161-424a-9a39-5e0a8c4e1e17-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-22a651ce-4161-424a-9a39-5e0a8c4e1e17-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "cinder-quobyte-22a651ce-4161-424a-9a39-5e0a8c4e1e17" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-quobyte-22a651ce-4161-424a-9a39-5e0a8c4e1e17" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7a7b65-3d69-4ba5-a545-e0aae98ea820]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:35 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 Aug 05 15:40:35 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:35 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 1G" returned: 0 in 0.593s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:35 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:35 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:35 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17" returned: 0 in 0.454s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:35 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17 Aug 05 15:40:35 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:35 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.369s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:35 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 is being set with open permissions: ugo+rw Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:35 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-22a651ce-4161-424a-9a39-5e0a8c4e1e17" returned: 0 in 0.273s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:35 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:35 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-quobyte-22a651ce-4161-424a-9a39-5e0a8c4e1e17" released by "delete_volume" :: held 0.784s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Created reservations ['75e59b7b-a27c-4a3c-84f8-1a39af3215ba', '70fb1a6b-b1bb-4316-944f-faf70891254b', 'c9283cc2-98d0-44a2-ab1d-ddce65eaa79e', '905c226f-5996-42f7-8b17-9309be2a44af'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:36 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:36 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:36 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:36 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info Aug 05 15:40:36 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:36 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.471s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Deleted volume successfully. Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "cinder-a3e7e889-977f-46f7-9a52-0674e6e0f8db-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:36 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-a3e7e889-977f-46f7-9a52-0674e6e0f8db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:36 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info is being set with open permissions: ugo+rw Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-25f9c445-db93-407e-90ad-7ec61e6d27f4 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-22a651ce-4161-424a-9a39-5e0a8c4e1e17-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:36 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info Aug 05 15:40:36 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "cinder-quobyte-a3e7e889-977f-46f7-9a52-0674e6e0f8db" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-quobyte-a3e7e889-977f-46f7-9a52-0674e6e0f8db" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0f4a6a-cb56-4e0a-9dff-6bfb63888912]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:36 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.info" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:36 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db Aug 05 15:40:36 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-69a3829d-3bcd-4d64-bcdd-61a5cf7092f0 tempest-VolumesDeleteCascade-1868710621 None] Create snapshot completed successfully Aug 05 15:40:37 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db" returned: 0 in 0.465s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:37 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db Aug 05 15:40:37 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:37 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a3e7e889-977f-46f7-9a52-0674e6e0f8db" returned: 0 in 0.350s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-quobyte-a3e7e889-977f-46f7-9a52-0674e6e0f8db" released by "delete_volume" :: held 0.867s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Created reservations ['b86665eb-8f65-4f21-85a4-f73798f25c98', '8a03c464-a3c2-4e2e-978f-63af9db14688', '02f26d5f-4de7-41d5-994b-d047c491d8ff', 'c7484453-dec1-40da-8638-1be1b3e25387'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Creating offline snapshot fe2fa958-62c2-45f3-97d6-027333be61d2 of volume 1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c2453d-62bc-49c8-a634-f4d7c67ec874]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Acquiring lock "cinder-bcf848bf-a4ec-42ef-8b15-b5990061b071-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "cinder-bcf848bf-a4ec-42ef-8b15-b5990061b071-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:38 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:38 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Acquiring lock "cinder-quobyte-bcf848bf-a4ec-42ef-8b15-b5990061b071" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "cinder-quobyte-bcf848bf-a4ec-42ef-8b15-b5990061b071" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[932275f4-bcb9-4fd5-83a6-62608accb6ac]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:38 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:38 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:38 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.361s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Deleted volume successfully. Aug 05 15:40:38 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 Aug 05 15:40:38 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e58a7da9-531d-4782-b96d-252ddbee1bd7 tempest-AttachVolumeNegativeTest-310103733 None] Lock "cinder-a3e7e889-977f-46f7-9a52-0674e6e0f8db-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:38 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.651s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b38a447-6f39-4daa-b367-0c8628a8c68f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:38 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 1G Aug 05 15:40:38 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:38 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071" returned: 0 in 0.591s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:38 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071 Aug 05 15:40:38 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:39 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:39 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf848bf-a4ec-42ef-8b15-b5990061b071" returned: 0 in 0.338s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 1G" returned: 0 in 0.565s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "cinder-quobyte-bcf848bf-a4ec-42ef-8b15-b5990061b071" released by "delete_volume" :: held 1.046s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:39 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 Aug 05 15:40:39 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Created reservations ['c04fbb06-4e7d-4294-a0fb-6ffa1e0fe2d2', 'ad61397f-d581-4249-8258-b0fc54a86e0f', '53f55d2e-d83d-4019-9165-1cdff3a403ed', 'd919ce1b-cbe3-4399-9834-95a61e9f39e0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:39 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:39 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:39 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2" returned: 0 in 0.408s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:39 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 is being set with open permissions: ugo+rw Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:39 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 Aug 05 15:40:39 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:39 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.294s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Deleted volume successfully. Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-31d9f828-d797-4769-b04b-1fb1aff207c8 tempest-AttachVolumeShelveTestJSON-1072210182 None] Lock "cinder-bcf848bf-a4ec-42ef-8b15-b5990061b071-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:39 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9e4009f0-c40b-4c8a-a200-d30d319b6c2b tempest-VolumesDeleteCascade-1868710621 None] Create snapshot completed successfully Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-1b38a447-6f39-4daa-b367-0c8628a8c68f-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-1b38a447-6f39-4daa-b367-0c8628a8c68f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Performing cascade delete. {{(pid=88999) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-945d83ce-4504-4642-8676-1ada163d0e63-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-945d83ce-4504-4642-8676-1ada163d0e63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-945d83ce-4504-4642-8676-1ada163d0e63" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-945d83ce-4504-4642-8676-1ada163d0e63" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Deleting offline snapshot 945d83ce-4504-4642-8676-1ada163d0e63 of volume 1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] snapshot_file for this snap is: volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[63428188-910a-4446-95be-7e4ab396b8db]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:41 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:41 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:41 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.404s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b38a447-6f39-4daa-b367-0c8628a8c68f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e43f129-dba9-41d1-a1d0-85e07bba9bd4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:41 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:41 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:41 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.358s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a361b8-5881-4cdd-b5dc-8a8885507d33]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:42 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 Aug 05 15:40:42 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:42 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2" returned: 0 in 0.494s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b38a447-6f39-4daa-b367-0c8628a8c68f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e29250f-65cd-4aac-adec-be8e256910f3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:42 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:42 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:43 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.456s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b38a447-6f39-4daa-b367-0c8628a8c68f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5eb619-48f5-4a04-9574-d9555f6d2549]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:43 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:43 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:43 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.420s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:43 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:43 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:43 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:43 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63 Aug 05 15:40:43 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:44 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.945d83ce-4504-4642-8676-1ada163d0e63" returned: 0 in 0.326s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 -F qcow2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:44 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 -F qcow2 Aug 05 15:40:44 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:44 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b38a447-6f39-4daa-b367-0c8628a8c68f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 -F qcow2" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-945d83ce-4504-4642-8676-1ada163d0e63" released by "_delete_snapshot" :: held 3.427s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" released by "delete_snapshot" :: held 3.456s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Created reservations ['5854783a-3aad-4a61-b29c-38467bac28d1', '0b28883a-53a1-4ad3-b4c2-e2fe0e673320', '9c605922-748b-4b42-8c98-55c30072ce9e', 'cee0b80a-0aaa-423a-bcfd-55fa5e159036'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Delete snapshot completed successfully. Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-945d83ce-4504-4642-8676-1ada163d0e63-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-fe2fa958-62c2-45f3-97d6-027333be61d2-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-fe2fa958-62c2-45f3-97d6-027333be61d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-fe2fa958-62c2-45f3-97d6-027333be61d2" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-fe2fa958-62c2-45f3-97d6-027333be61d2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Deleting offline snapshot fe2fa958-62c2-45f3-97d6-027333be61d2 of volume 1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] snapshot_file for this snap is: volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8fcb17-f042-45a0-895d-5059837579b6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:44 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 Aug 05 15:40:44 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:45 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2" returned: 0 in 0.429s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b38a447-6f39-4daa-b367-0c8628a8c68f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:45 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea1c3d-8350-437e-b0f9-1965ce1afa81]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:45 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:45 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:45 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.503s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:45 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 Aug 05 15:40:45 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:46 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:46 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2 Aug 05 15:40:46 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:46 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f.fe2fa958-62c2-45f3-97d6-027333be61d2" returned: 0 in 0.253s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-fe2fa958-62c2-45f3-97d6-027333be61d2" released by "_delete_snapshot" :: held 1.686s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" released by "delete_snapshot" :: held 1.715s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Created reservations ['19ce4e3c-6d55-49d5-b064-77f3132fbbf1', '3b970dcc-c7e7-408f-9135-002da85ed101', '436a50bf-799e-4e72-a563-0cc58081f027', '8aa22f85-cfbd-4f7a-8d0a-b1578a5e44ad'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:46 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Delete snapshot completed successfully. Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-fe2fa958-62c2-45f3-97d6-027333be61d2-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Snapshots deleted, issuing volume delete {{(pid=88999) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b150cd6-fef8-4f3f-bdfb-6dac03bc3342]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:46 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:46 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:47 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.441s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:47 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f Aug 05 15:40:47 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:47 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b38a447-6f39-4daa-b367-0c8628a8c68f" returned: 0 in 0.300s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-1b38a447-6f39-4daa-b367-0c8628a8c68f" released by "delete_volume" :: held 0.827s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Created reservations ['3224460c-82a9-486e-83f2-5099b84d854c', 'd555e7f5-443f-4063-8c4f-d61c4a356d52', 'b4a30c8e-4e75-4bb5-a129-a25dacec4bce', '4abd9dae-eaa0-4038-86e4-e7563080a341'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:47 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:47 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:48 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:48 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Deleted volume successfully. Aug 05 15:40:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3760c08d-2764-466b-8b81-c6ffd33dde51 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-1b38a447-6f39-4daa-b367-0c8628a8c68f-delete_volume" released by "delete_volume" :: held 7.126s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Flow 'volume_create_manager' (7cf3f3ab-276a-45e7-8431-45ce55873f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb33152-7d94-4366-9046-b658d8c2eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb33152-7d94-4366-9046-b658d8c2eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1445430808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb88dc1-9ec2-4be7-a895-caf917cb00f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af566a87926414ab9688f1b68657ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:50Z,use_quota=True,user_id='26a83e916b0742b6a56c4fab2b4f64a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a80d490-8af7-4f9f-8bec-5665c977abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a80d490-8af7-4f9f-8bec-5665c977abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f2e62b-6485-46d0-8c39-90a756552369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f2e62b-6485-46d0-8c39-90a756552369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb88dc1-9ec2-4be7-a895-caf917cb00f6', 'volume_name': 'volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a27abe4-d0aa-4a44-8294-a7ae9f8ed59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a27abe4-d0aa-4a44-8294-a7ae9f8ed59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3a0cc0-16c1-4e78-8213-f7501a88788d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Volume beb88dc1-9ec2-4be7-a895-caf917cb00f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6', 'volume_size': 1} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1445430808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb88dc1-9ec2-4be7-a895-caf917cb00f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af566a87926414ab9688f1b68657ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:50Z,use_quota=True,user_id='26a83e916b0742b6a56c4fab2b4f64a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Creating volume beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:50 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:50 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 1073741824 Aug 05 15:40:50 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:50 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 1073741824" returned: 0 in 0.513s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:50 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 Aug 05 15:40:50 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:50 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc3a0cc0-16c1-4e78-8213-f7501a88788d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dd5677-bb53-4408-972e-1da3864e9dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Volume volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 (beb88dc1-9ec2-4be7-a895-caf917cb00f6): created successfully Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53dd5677-bb53-4408-972e-1da3864e9dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Flow 'volume_create_manager' (7cf3f3ab-276a-45e7-8431-45ce55873f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:50 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5ec07ade-c94c-4936-8d6c-0fe7d554dca8 tempest-VolumesDeleteCascade-1868710621 None] Created volume successfully. Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Creating offline snapshot 246e6aa8-a265-448c-b341-58831b75872d of volume beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcc9eb0-5456-4b9b-8807-1866b1edd771]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:52 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 Aug 05 15:40:52 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:52 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6" returned: 0 in 0.521s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:52 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d 1G Aug 05 15:40:52 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Flow 'volume_create_manager' (f8c22445-fec9-474d-82db-8064e6fb6186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a364fa16-9c82-4af3-a1ef-b17f2d5ac1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a364fa16-9c82-4af3-a1ef-b17f2d5ac1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-325769308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dc838a-beeb-4073-9681-d9306353afff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb80fc71ded497da06e316bf3ea4100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:53Z,use_quota=True,user_id='b2fa6c3fff0d4321a66cd5493268fb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60d783d-83a0-4e79-bae6-e6a15ce588bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60d783d-83a0-4e79-bae6-e6a15ce588bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e2a1a8-5bd0-480c-8473-d5d93a94542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40e2a1a8-5bd0-480c-8473-d5d93a94542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12dc838a-beeb-4073-9681-d9306353afff', 'volume_name': 'volume-12dc838a-beeb-4073-9681-d9306353afff', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b78f99-9583-450a-815f-c1e1e2214875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86b78f99-9583-450a-815f-c1e1e2214875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e673e6e-9d73-4b1d-b9a6-8143d3aae413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Volume 12dc838a-beeb-4073-9681-d9306353afff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12dc838a-beeb-4073-9681-d9306353afff', 'volume_size': 1} Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:53 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d 1G" returned: 0 in 0.503s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:53 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d Aug 05 15:40:53 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7e3ad571-c859-4c6e-a9fa-c9e6cac9df6c tempest-GroupSnapshotsTest-2040095227 None] Group tempest-GroupSnapshotsTest-Group-1588376484: creating Aug 05 15:40:53 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d" returned: 0 in 0.333s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:53 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d is being set with open permissions: ugo+rw Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:53 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d Aug 05 15:40:53 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7e3ad571-c859-4c6e-a9fa-c9e6cac9df6c tempest-GroupSnapshotsTest-2040095227 None] Group tempest-GroupSnapshotsTest-Group-1588376484: created successfully Aug 05 15:40:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7e3ad571-c859-4c6e-a9fa-c9e6cac9df6c tempest-GroupSnapshotsTest-2040095227 None] Create group completed successfully. Aug 05 15:40:53 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:53 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info Aug 05 15:40:53 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:54 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info" returned: 0 in 0.268s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:54 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info is being set with open permissions: ugo+rw Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:54 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info Aug 05 15:40:54 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:54 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.info" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.405s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-325769308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dc838a-beeb-4073-9681-d9306353afff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dfb80fc71ded497da06e316bf3ea4100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:53Z,use_quota=True,user_id='b2fa6c3fff0d4321a66cd5493268fb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Creating volume 12dc838a-beeb-4073-9681-d9306353afff {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:54 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:54 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff 1073741824 Aug 05 15:40:54 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d86b847e-1fe8-40b0-b9fa-0b9ea15f8630 tempest-VolumesDeleteCascade-1868710621 None] Create snapshot completed successfully Aug 05 15:40:54 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff 1073741824" returned: 0 in 0.533s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=119,cinder:INSERT=39,cinder:UPDATE=139,cinder:DELETE=9 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:40:54 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=141,cinder:SELECT=114,cinder:INSERT=31,cinder:DELETE=13 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:55 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff Aug 05 15:40:55 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:55 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (b260b0d7-da12-4d37-bfd7-389a48f6fcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7e582c-0ab5-490c-b79a-f9549bfdadf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff" returned: 0 in 0.388s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e673e6e-9d73-4b1d-b9a6-8143d3aae413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12dc838a-beeb-4073-9681-d9306353afff', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a19506-8bd9-42eb-a58f-6ce262d400ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec7e582c-0ab5-490c-b79a-f9549bfdadf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1702860432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aadba09-b2f9-4748-a38c-ab4d2f779a5e,host='devstack@QuobyteHD#QuobyteHD',id=f9d47553-9534-41a4-b38f-93d41f267866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:55Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1d8b05c-b504-4939-8d98-38d3807870c3),volume_type_id=e1d8b05c-b504-4939-8d98-38d3807870c3)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5153e7c3-031d-4c46-a2c6-6f2eaf407749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5153e7c3-031d-4c46-a2c6-6f2eaf407749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e1a764-aec1-4206-aa6c-836959b09f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e1a764-aec1-4206-aa6c-836959b09f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d47553-9534-41a4-b38f-93d41f267866', 'volume_name': 'volume-f9d47553-9534-41a4-b38f-93d41f267866', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873606eb-4358-4f8f-8978-8ba8bae27d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873606eb-4358-4f8f-8978-8ba8bae27d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79f2ace-53d8-410d-ac84-cb23a3ec1847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Volume f9d47553-9534-41a4-b38f-93d41f267866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d47553-9534-41a4-b38f-93d41f267866', 'volume_size': 1} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3aadba09-b2f9-4748-a38c-ab4d2f779a5e,created_at=2026-08-05T13:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1702860432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3aadba09-b2f9-4748-a38c-ab4d2f779a5e,host='devstack@QuobyteHD#QuobyteHD',id=f9d47553-9534-41a4-b38f-93d41f267866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:55Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e1d8b05c-b504-4939-8d98-38d3807870c3),volume_type_id=e1d8b05c-b504-4939-8d98-38d3807870c3)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Creating volume f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:55 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:55 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Volume volume-12dc838a-beeb-4073-9681-d9306353afff (12dc838a-beeb-4073-9681-d9306353afff): created successfully Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44a19506-8bd9-42eb-a58f-6ce262d400ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 1073741824 Aug 05 15:40:55 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Flow 'volume_create_manager' (f8c22445-fec9-474d-82db-8064e6fb6186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-333ff5e8-b536-4001-bde5-ebe0dd9dfdd3 req-88097da2-8027-4554-b1a1-552dc8c9eabb tempest-VolumesGetTestJSON-1229105008 None] Created volume successfully. Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Flow 'volume_create_manager' (ca4ed5fd-362c-44ee-82ca-5fc11013c8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1188f7f6-4cec-48fd-8181-7c549400dfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1188f7f6-4cec-48fd-8181-7c549400dfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1537177093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664f0a2c-5b72-4829-9c6d-e576b273f2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af566a87926414ab9688f1b68657ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=246e6aa8-a265-448c-b341-58831b75872d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:40:56Z,use_quota=True,user_id='26a83e916b0742b6a56c4fab2b4f64a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc0ac0d-2fee-499e-b726-be880836d4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc0ac0d-2fee-499e-b726-be880836d4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d685e9c-bce5-40d5-908d-0f3885e46c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d685e9c-bce5-40d5-908d-0f3885e46c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '664f0a2c-5b72-4829-9c6d-e576b273f2be', 'volume_name': 'volume-664f0a2c-5b72-4829-9c6d-e576b273f2be', 'volume_size': 1, 'snapshot_id': '246e6aa8-a265-448c-b341-58831b75872d'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e2865a-4e67-4af3-9d31-3b7a56f592c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78e2865a-4e67-4af3-9d31-3b7a56f592c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:56 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3eca68a-35ab-4c64-a379-10c09f68de1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Volume 664f0a2c-5b72-4829-9c6d-e576b273f2be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-664f0a2c-5b72-4829-9c6d-e576b273f2be', 'volume_size': 1, 'snapshot_id': '246e6aa8-a265-448c-b341-58831b75872d'} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 1073741824" returned: 0 in 0.525s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:56 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 Aug 05 15:40:56 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:56 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.487s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-246e6aa8-a265-448c-b341-58831b75872d-664f0a2c-5b72-4829-9c6d-e576b273f2be" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79f2ace-53d8-410d-ac84-cb23a3ec1847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d47553-9534-41a4-b38f-93d41f267866', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4415d303-b6e9-48b7-b363-7aa6eb0a103f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-246e6aa8-a265-448c-b341-58831b75872d-664f0a2c-5b72-4829-9c6d-e576b273f2be" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Creating volume 664f0a2c-5b72-4829-9c6d-e576b273f2be from snapshot 246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-664f0a2c-5b72-4829-9c6d-e576b273f2be" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Volume volume-f9d47553-9534-41a4-b38f-93d41f267866 (f9d47553-9534-41a4-b38f-93d41f267866): created successfully Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4415d303-b6e9-48b7-b363-7aa6eb0a103f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (b260b0d7-da12-4d37-bfd7-389a48f6fcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-664f0a2c-5b72-4829-9c6d-e576b273f2be" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] snapshot: 246e6aa8-a265-448c-b341-58831b75872d, volume: 664f0a2c-5b72-4829-9c6d-e576b273f2be, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ec96e255-4bf0-4c87-bb45-982ef4d2ed51 tempest-GroupSnapshotsTest-2040095227 None] Created volume successfully. Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8adc54-f554-46b7-803f-e44353a80aaf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Acquiring lock "cinder-12dc838a-beeb-4073-9681-d9306353afff-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Lock "cinder-12dc838a-beeb-4073-9681-d9306353afff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Acquiring lock "cinder-quobyte-12dc838a-beeb-4073-9681-d9306353afff" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:40:56 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d Aug 05 15:40:56 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Lock "cinder-quobyte-12dc838a-beeb-4073-9681-d9306353afff" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[50874c79-ddae-4a13-aca8-fc6096da87d4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:57 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff Aug 05 15:40:57 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:57 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d" returned: 0 in 0.500s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[930145ab-d657-43b0-bc77-024b7370961f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:57 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 Aug 05 15:40:57 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:57 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:57 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff Aug 05 15:40:57 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:57 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6" returned: 0 in 0.424s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:57 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12dc838a-beeb-4073-9681-d9306353afff" returned: 0 in 0.294s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:57 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be Aug 05 15:40:57 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Lock "cinder-quobyte-12dc838a-beeb-4073-9681-d9306353afff" released by "delete_volume" :: held 0.821s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.quota [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Created reservations ['8eea03f3-e306-4095-88d2-2d289cf22629', '94377d68-4c2e-4a04-8163-e464770f8547', '29212957-8a48-491f-91ce-87a454140d17', 'f69da59f-4fc9-4cdd-9e74-364d26556a59'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:40:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:40:57 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:40:57 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:40:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] GroupSnapshot b366e33b-6b96-4113-8ed5-9fb5444dae2c: creating. Aug 05 15:40:58 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Group snapshot b366e33b-6b96-4113-8ed5-9fb5444dae2c: creating. {{(pid=88999) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:40:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:40:58 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Aug 05 15:40:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:40:58 devstack cinder-volume[88999]: DEBUG cinder.manager [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:40:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Deleted volume successfully. Aug 05 15:40:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-d8039b29-e87e-4e76-b91c-cf9be174cb1b req-d2ed05ac-2b5a-49f7-87ef-d78496f34d45 tempest-VolumesGetTestJSON-1229105008 None] Lock "cinder-12dc838a-beeb-4073-9681-d9306353afff-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:03 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be" returned: 0 in 5.791s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:41:03 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Converted 1024.00 MB image at 176.80 MB/s Aug 05 15:41:03 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be is being set with open permissions: ugo+rw Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:03 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be Aug 05 15:41:03 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:03 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be" returned: 0 in 0.294s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-664f0a2c-5b72-4829-9c6d-e576b273f2be" released by "_copy_volume_from_snapshot" :: held 7.116s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-246e6aa8-a265-448c-b341-58831b75872d-664f0a2c-5b72-4829-9c6d-e576b273f2be" released by "_create_volume_from_snapshot" :: held 7.221s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.276s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.620s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Creating offline snapshot 29010c20-fd32-49d9-9de8-eb3ce6d7181e of volume f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3eca68a-35ab-4c64-a379-10c09f68de1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664f0a2c-5b72-4829-9c6d-e576b273f2be', 'volume_size': 1, 'snapshot_id': '246e6aa8-a265-448c-b341-58831b75872d'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffb2ffd-82ac-4c9f-b9a3-c8cf47193e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff1d2cd-74fd-4919-aadd-b92cd80f0ddd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:03 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Volume volume-664f0a2c-5b72-4829-9c6d-e576b273f2be (664f0a2c-5b72-4829-9c6d-e576b273f2be): created successfully Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ffb2ffd-82ac-4c9f-b9a3-c8cf47193e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Flow 'volume_create_manager' (ca4ed5fd-362c-44ee-82ca-5fc11013c8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-54620ef9-e829-4719-8d42-b3c9589f3a0b tempest-VolumesDeleteCascade-1868710621 None] Created volume successfully. Aug 05 15:41:04 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 Aug 05 15:41:04 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:04 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866" returned: 0 in 0.443s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:04 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e 1G Aug 05 15:41:04 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-beb88dc1-9ec2-4be7-a895-caf917cb00f6-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:04 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e 1G" returned: 0 in 0.548s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d47553-9534-41a4-b38f-93d41f267866 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-beb88dc1-9ec2-4be7-a895-caf917cb00f6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:04 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d47553-9534-41a4-b38f-93d41f267866 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e Aug 05 15:41:04 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Performing cascade delete. {{(pid=88999) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-246e6aa8-a265-448c-b341-58831b75872d-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-246e6aa8-a265-448c-b341-58831b75872d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-beb88dc1-9ec2-4be7-a895-caf917cb00f6" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-beb88dc1-9ec2-4be7-a895-caf917cb00f6" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-246e6aa8-a265-448c-b341-58831b75872d" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-246e6aa8-a265-448c-b341-58831b75872d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Deleting offline snapshot 246e6aa8-a265-448c-b341-58831b75872d of volume beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] snapshot_file for this snap is: volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7596df49-8da6-4483-ab75-fbb0a7d9a457]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:05 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d Aug 05 15:41:05 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:05 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d47553-9534-41a4-b38f-93d41f267866 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e" returned: 0 in 0.566s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:05 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:05 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e Aug 05 15:41:05 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:05 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d" returned: 0 in 0.649s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44861b5-7c9e-4b91-8a91-ca03672b9efa]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:05 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e" returned: 0 in 0.504s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:05 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Flow 'volume_create_manager' (593c571c-3c30-418a-b649-30c3892694d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeb0d50-7256-417b-bae3-cf702e3f088a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:06 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 Aug 05 15:41:06 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeeb0d50-7256-417b-bae3-cf702e3f088a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1625296031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4872c-f873-4d31-9acd-5aa1f0c04584,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='963fc23c64a140f8bbce2637c3b1ae76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:06Z,use_quota=True,user_id='16c93fb6cef64418b0ebb7dc3cdeb58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450dac4c-f2b1-4c45-8c0e-10ce0d7be073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (450dac4c-f2b1-4c45-8c0e-10ce0d7be073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:06 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info Aug 05 15:41:06 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5418de8a-fbb5-49af-917b-5b609366a0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5418de8a-fbb5-49af-917b-5b609366a0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf4872c-f873-4d31-9acd-5aa1f0c04584', 'volume_name': 'volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c8a313-9431-4a28-9738-380cb42b15f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8c8a313-9431-4a28-9738-380cb42b15f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305d5b1e-923e-44f4-b845-650aac607eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Volume bcf4872c-f873-4d31-9acd-5aa1f0c04584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584', 'volume_size': 1} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:06 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info" returned: 0 in 0.352s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:06 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:06 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info Aug 05 15:41:06 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:06 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6" returned: 0 in 0.775s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:06 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d Aug 05 15:41:06 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:06 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.info" returned: 0 in 0.272s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.898s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1625296031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf4872c-f873-4d31-9acd-5aa1f0c04584,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='963fc23c64a140f8bbce2637c3b1ae76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:06Z,use_quota=True,user_id='16c93fb6cef64418b0ebb7dc3cdeb58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Creating volume bcf4872c-f873-4d31-9acd-5aa1f0c04584 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:06 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:06 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 1073741824 Aug 05 15:41:06 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:06 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6052ed39-6b1b-4dab-bdce-53e6b2dc8cfa tempest-GroupSnapshotsTest-2040095227 None] group_snapshot b366e33b-6b96-4113-8ed5-9fb5444dae2c: created successfully Aug 05 15:41:07 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d" returned: 0 in 0.425s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:07 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d Aug 05 15:41:07 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:07 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 1073741824" returned: 0 in 0.509s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:07 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 Aug 05 15:41:07 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:07 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6.246e6aa8-a265-448c-b341-58831b75872d" returned: 0 in 0.278s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-246e6aa8-a265-448c-b341-58831b75872d" released by "_delete_snapshot" :: held 2.280s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-beb88dc1-9ec2-4be7-a895-caf917cb00f6" released by "delete_snapshot" :: held 2.311s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Created reservations ['d906068f-4974-4f8e-99c1-4fdc915cad9c', 'b195e224-24c6-4513-aca9-4f08c0460738', '63922c89-0bca-46bf-bd11-bc043ec3e05a', 'f3abda93-55e3-4dfa-90c4-efa36790fd66'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Delete snapshot completed successfully. Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-246e6aa8-a265-448c-b341-58831b75872d-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Snapshots deleted, issuing volume delete {{(pid=88999) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-beb88dc1-9ec2-4be7-a895-caf917cb00f6" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:07 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-beb88dc1-9ec2-4be7-a895-caf917cb00f6" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305d5b1e-923e-44f4-b845-650aac607eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319eea51-9f33-42cb-8a32-5be74e0d693d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd98ba1-e9cf-46c3-9cf4-95e1fb721848]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Volume volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 (bcf4872c-f873-4d31-9acd-5aa1f0c04584): created successfully Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319eea51-9f33-42cb-8a32-5be74e0d693d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Flow 'volume_create_manager' (593c571c-3c30-418a-b649-30c3892694d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-918bc7df-7906-44b4-abab-a230e82bdac8 tempest-VolumesTestJSON-120731726 None] Created volume successfully. Aug 05 15:41:07 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 Aug 05 15:41:07 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:08 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6" returned: 0 in 0.429s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:08 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6 Aug 05 15:41:08 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:08 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-beb88dc1-9ec2-4be7-a895-caf917cb00f6" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-beb88dc1-9ec2-4be7-a895-caf917cb00f6" released by "delete_volume" :: held 0.878s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Created reservations ['536bc8e1-9be1-43cc-9e22-344d95e1e72f', '4ca693aa-abd1-4d2d-9bdf-12e897ab874d', '190a27e0-46fa-4cf7-932d-85cce507e2ff', '17a8f5c3-af22-4231-9624-16c260de4424'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:08 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:08 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Flow 'volume_create_manager' (ea0f857e-5f88-436d-a270-ff315a255179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4c98ed-fef1-4c39-982a-f910d013c56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4c98ed-fef1-4c39-982a-f910d013c56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1739144304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69435851-812a-4707-928c-7f857e4471e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='963fc23c64a140f8bbce2637c3b1ae76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:09Z,use_quota=True,user_id='16c93fb6cef64418b0ebb7dc3cdeb58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0c8d46-4cf1-4bb7-9a41-d49087f4a726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0c8d46-4cf1-4bb7-9a41-d49087f4a726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c311b904-920c-4ca4-a733-342354c2b9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c311b904-920c-4ca4-a733-342354c2b9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69435851-812a-4707-928c-7f857e4471e2', 'volume_name': 'volume-69435851-812a-4707-928c-7f857e4471e2', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2e64b4-afc3-42b3-881b-b429295f4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2e64b4-afc3-42b3-881b-b429295f4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b7697-9ecc-4ca5-96a2-6f2e685366c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Volume 69435851-812a-4707-928c-7f857e4471e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69435851-812a-4707-928c-7f857e4471e2', 'volume_size': 1} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1739144304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69435851-812a-4707-928c-7f857e4471e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='963fc23c64a140f8bbce2637c3b1ae76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:09Z,use_quota=True,user_id='16c93fb6cef64418b0ebb7dc3cdeb58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Creating volume 69435851-812a-4707-928c-7f857e4471e2 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:08 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:08 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 1073741824 Aug 05 15:41:08 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:08 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.324s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:08 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:08 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Deleted volume successfully. Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7332f39-f954-4c61-88f8-8eeff7acfb8c tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-beb88dc1-9ec2-4be7-a895-caf917cb00f6-delete_volume" released by "delete_volume" :: held 4.132s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:09 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 1073741824" returned: 0 in 0.531s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:09 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 Aug 05 15:41:09 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:09 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.741s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-29010c20-fd32-49d9-9de8-eb3ce6d7181e-a731fb39-f592-4a74-8905-e182809a75ef" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b7697-9ecc-4ca5-96a2-6f2e685366c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69435851-812a-4707-928c-7f857e4471e2', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928e4cb1-9b8e-4fe0-b35f-79bcfd162474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-29010c20-fd32-49d9-9de8-eb3ce6d7181e-a731fb39-f592-4a74-8905-e182809a75ef" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Creating volume a731fb39-f592-4a74-8905-e182809a75ef from snapshot 29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-a731fb39-f592-4a74-8905-e182809a75ef" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-a731fb39-f592-4a74-8905-e182809a75ef" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] snapshot: 29010c20-fd32-49d9-9de8-eb3ce6d7181e, volume: a731fb39-f592-4a74-8905-e182809a75ef, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:41:09 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Volume volume-69435851-812a-4707-928c-7f857e4471e2 (69435851-812a-4707-928c-7f857e4471e2): created successfully Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928e4cb1-9b8e-4fe0-b35f-79bcfd162474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Flow 'volume_create_manager' (ea0f857e-5f88-436d-a270-ff315a255179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:09 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3fba8703-f111-4aea-92a6-50a013fa88f2 tempest-VolumesTestJSON-120731726 None] Created volume successfully. Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-664f0a2c-5b72-4829-9c6d-e576b273f2be-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c794233d-c4dd-4cec-b460-2e455d264147]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-664f0a2c-5b72-4829-9c6d-e576b273f2be-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "cinder-quobyte-664f0a2c-5b72-4829-9c6d-e576b273f2be" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-664f0a2c-5b72-4829-9c6d-e576b273f2be" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a47d236-ec23-42ba-97bd-5967ac950e5b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:10 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e Aug 05 15:41:10 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:10 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:10 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:10 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:10 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:10 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e" returned: 0 in 0.632s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d47553-9534-41a4-b38f-93d41f267866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:41:10 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be" returned: 0 in 0.518s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f64d35-6995-4fc9-9c33-9991806782b5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:10 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:10 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be Aug 05 15:41:10 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Flow 'volume_create_manager' (500a9fb2-e239-4a9b-94cd-94f180625557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db63f08-2623-49c8-b3c3-418fd6f399f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.467s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db63f08-2623-49c8-b3c3-418fd6f399f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2123765109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043a2c61-ba7a-4f36-b68d-c9205e3934b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80efa18020cb4a0197f089a488afe18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:10Z,use_quota=True,user_id='36a7363dd8e844a285da52e9ba71ab54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cc602cb-090a-477c-ac4d-1f0ecde07144),volume_type_id=1cc602cb-090a-477c-ac4d-1f0ecde07144)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba5a2e8-92e3-4967-9830-0758dc814770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba5a2e8-92e3-4967-9830-0758dc814770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53c5c54-a5a6-469d-aed7-f29846db8ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53c5c54-a5a6-469d-aed7-f29846db8ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043a2c61-ba7a-4f36-b68d-c9205e3934b1', 'volume_name': 'volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62baecb2-43c8-4e51-88e2-6cb1618fafc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62baecb2-43c8-4e51-88e2-6cb1618fafc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dbfd5b-1c0d-4361-9a55-700ea75f3d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume 043a2c61-ba7a-4f36-b68d-c9205e3934b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1', 'volume_size': 1} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:10 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 Aug 05 15:41:10 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:10 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-664f0a2c-5b72-4829-9c6d-e576b273f2be" returned: 0 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-quobyte-664f0a2c-5b72-4829-9c6d-e576b273f2be" released by "delete_volume" :: held 0.943s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Flow 'volume_create_manager' (a82bdf43-b7a7-4ad2-a126-1ea09c7995b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc310f20-3729-4885-9fe1-7181b0d0f7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc310f20-3729-4885-9fe1-7181b0d0f7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-636558544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64da106-0e43-4ad9-9a93-4790b975d087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80efa18020cb4a0197f089a488afe18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:11Z,use_quota=True,user_id='36a7363dd8e844a285da52e9ba71ab54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460dfd83-67d1-4e84-8a69-8adb68ed26fc),volume_type_id=460dfd83-67d1-4e84-8a69-8adb68ed26fc)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abde4dd-0d77-4419-bc52-0052c4abf9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1abde4dd-0d77-4419-bc52-0052c4abf9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb31d58-1770-402c-b7af-e3efcf657581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edb31d58-1770-402c-b7af-e3efcf657581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64da106-0e43-4ad9-9a93-4790b975d087', 'volume_name': 'volume-d64da106-0e43-4ad9-9a93-4790b975d087', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b81e99-aeee-4b3f-9e6d-997cd0ef1acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b81e99-aeee-4b3f-9e6d-997cd0ef1acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d06a9f5-167f-4534-be39-83eb113267d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume d64da106-0e43-4ad9-9a93-4790b975d087: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64da106-0e43-4ad9-9a93-4790b975d087', 'volume_size': 1} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Created reservations ['8f937baf-07a2-4c12-aac3-9a882ef399c3', '205dc4ad-c553-4fb1-a652-51963c2480db', '21207f4e-cbd5-4e25-b881-e69076108138', '9e23effe-e143-491d-acfd-ee0a3405a0e9'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:11 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866" returned: 0 in 0.594s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:11 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:11 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:11 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef Aug 05 15:41:11 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:11 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.329s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Deleted volume successfully. Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4b92036b-2a82-4491-a73f-81a2e3d61d07 tempest-VolumesDeleteCascade-1868710621 None] Lock "cinder-664f0a2c-5b72-4829-9c6d-e576b273f2be-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Flow 'volume_create_manager' (fe681dc6-3365-41c4-92e8-8a5b3743ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2a36f-b73f-4f7d-8c4e-d9086473fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf2a36f-b73f-4f7d-8c4e-d9086473fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-622597751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14358128-ee3b-46da-bc4d-23694a7b1ddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='963fc23c64a140f8bbce2637c3b1ae76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:12Z,use_quota=True,user_id='16c93fb6cef64418b0ebb7dc3cdeb58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2217d2b0-3ec3-402c-91e5-cac1bd781563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2217d2b0-3ec3-402c-91e5-cac1bd781563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf3ea3c-7cd6-4c32-8453-151b78f7e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbf3ea3c-7cd6-4c32-8453-151b78f7e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14358128-ee3b-46da-bc4d-23694a7b1ddc', 'volume_name': 'volume-14358128-ee3b-46da-bc4d-23694a7b1ddc', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ec4530-8dc2-422a-8718-70159d69a90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ec4530-8dc2-422a-8718-70159d69a90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf2a44e-2770-46a9-9660-1bf0e2eb5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Volume 14358128-ee3b-46da-bc4d-23694a7b1ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14358128-ee3b-46da-bc4d-23694a7b1ddc', 'volume_size': 1} Aug 05 15:41:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Flow 'volume_create_manager' (10d10820-9cb6-4487-9a33-9de23f858924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4795c5c-d7ba-4d2b-b385-162bced4960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4795c5c-d7ba-4d2b-b385-162bced4960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1319744854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1859aa80-3f44-4546-b194-b343d1a9d3ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80efa18020cb4a0197f089a488afe18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:12Z,use_quota=True,user_id='36a7363dd8e844a285da52e9ba71ab54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca634934-1a01-4987-af74-efd34b86a249),volume_type_id=ca634934-1a01-4987-af74-efd34b86a249)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cd44f5-5557-4b1d-8c1e-21bbf1a9b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cd44f5-5557-4b1d-8c1e-21bbf1a9b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2033fc5-3c0e-4594-8b61-71a071daeb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:12 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:41:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2033fc5-3c0e-4594-8b61-71a071daeb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1859aa80-3f44-4546-b194-b343d1a9d3ea', 'volume_name': 'volume-1859aa80-3f44-4546-b194-b343d1a9d3ea', 'volume_size': 1, 'image_id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57f71d08-6087-4139-b5a9-668b08a6d5b4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--534047732', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80efa18020cb4a0197f089a488afe18c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57f71d08-6087-4139-b5a9-668b08a6d5b4/file', 'properties': {}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb5ef2-b0c6-46d6-b2ea-b8561ec109e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5cb5ef2-b0c6-46d6-b2ea-b8561ec109e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849135a2-f6dc-46e0-a9ce-663da630df2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume 1859aa80-3f44-4546-b194-b343d1a9d3ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1859aa80-3f44-4546-b194-b343d1a9d3ea', 'volume_size': 1, 'image_id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57f71d08-6087-4139-b5a9-668b08a6d5b4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--534047732', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80efa18020cb4a0197f089a488afe18c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57f71d08-6087-4139-b5a9-668b08a6d5b4/file', 'properties': {}}, 'image_service': } Aug 05 15:41:13 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Trying to clone 1859aa80-3f44-4546-b194-b343d1a9d3ea from image 57f71d08-6087-4139-b5a9-668b08a6d5b4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57f71d08-6087-4139-b5a9-668b08a6d5b4', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:41:16 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef" returned: 0 in 5.814s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:16 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:41:16 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Converted 1024.00 MB image at 176.08 MB/s Aug 05 15:41:16 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:17 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef Aug 05 15:41:17 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:17 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-a731fb39-f592-4a74-8905-e182809a75ef" released by "_copy_volume_from_snapshot" :: held 7.497s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-29010c20-fd32-49d9-9de8-eb3ce6d7181e-a731fb39-f592-4a74-8905-e182809a75ef" released by "_create_volume_from_snapshot" :: held 7.598s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.645s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.661s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2123765109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043a2c61-ba7a-4f36-b68d-c9205e3934b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80efa18020cb4a0197f089a488afe18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:10Z,use_quota=True,user_id='36a7363dd8e844a285da52e9ba71ab54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1cc602cb-090a-477c-ac4d-1f0ecde07144),volume_type_id=1cc602cb-090a-477c-ac4d-1f0ecde07144)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Creating volume 043a2c61-ba7a-4f36-b68d-c9205e3934b1 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:17 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:17 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 1073741824 Aug 05 15:41:17 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-176d9bf6-1cf8-49e4-87a1-5ed948b21270 tempest-GroupSnapshotsTest-2040095227 None] Create group from source-snapshot-b366e33b-6b96-4113-8ed5-9fb5444dae2c completed successfully. Aug 05 15:41:17 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 1073741824" returned: 0 in 0.535s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:17 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 Aug 05 15:41:17 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:18 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1" returned: 0 in 0.274s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.193s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-636558544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64da106-0e43-4ad9-9a93-4790b975d087,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80efa18020cb4a0197f089a488afe18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:11Z,use_quota=True,user_id='36a7363dd8e844a285da52e9ba71ab54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(460dfd83-67d1-4e84-8a69-8adb68ed26fc),volume_type_id=460dfd83-67d1-4e84-8a69-8adb68ed26fc)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Creating volume d64da106-0e43-4ad9-9a93-4790b975d087 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:18 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0dbfd5b-1c0d-4361-9a55-700ea75f3d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:18 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 1073741824 Aug 05 15:41:18 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c220a646-3d42-4280-bae1-9c38179e4e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:18 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 (043a2c61-ba7a-4f36-b68d-c9205e3934b1): created successfully Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c220a646-3d42-4280-bae1-9c38179e4e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Flow 'volume_create_manager' (500a9fb2-e239-4a9b-94cd-94f180625557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e9a6cd1a-23d2-4f04-974e-43a910f67783 tempest-TestInstancesWithCinderVolumes-1806207960 None] Created volume successfully. Aug 05 15:41:18 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 1073741824" returned: 0 in 0.550s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:18 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 Aug 05 15:41:18 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:19 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087" returned: 0 in 0.375s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.252s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-622597751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14358128-ee3b-46da-bc4d-23694a7b1ddc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='963fc23c64a140f8bbce2637c3b1ae76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:12Z,use_quota=True,user_id='16c93fb6cef64418b0ebb7dc3cdeb58f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Creating volume 14358128-ee3b-46da-bc4d-23694a7b1ddc {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:19 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d06a9f5-167f-4534-be39-83eb113267d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64da106-0e43-4ad9-9a93-4790b975d087', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee359ef5-c572-4012-9d35-bd9e16c03b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:19 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc 1073741824 Aug 05 15:41:19 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:19 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume volume-d64da106-0e43-4ad9-9a93-4790b975d087 (d64da106-0e43-4ad9-9a93-4790b975d087): created successfully Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee359ef5-c572-4012-9d35-bd9e16c03b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Flow 'volume_create_manager' (a82bdf43-b7a7-4ad2-a126-1ea09c7995b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-a731fb39-f592-4a74-8905-e182809a75ef" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6d65b8bb-b347-4295-89c9-98b832552e97 tempest-TestInstancesWithCinderVolumes-1806207960 None] Created volume successfully. Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-a731fb39-f592-4a74-8905-e182809a75ef" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f789ae4d-b2cd-4591-beca-050718928b2a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:19 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef Aug 05 15:41:19 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:19 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc 1073741824" returned: 0 in 0.583s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD, size 20.69 MB, duration 6.18 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:41:19 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Image download 20.69 MB at 3.35 MB/s Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:19 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef" returned: 0 in 0.492s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:19 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc Aug 05 15:41:19 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[134b91a3-d4ef-4e74-b513-251e79ef25ab]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:19 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef Aug 05 15:41:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:19 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:20 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD Aug 05 15:41:20 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:20 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc" returned: 0 in 0.320s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cf2a44e-2770-46a9-9660-1bf0e2eb5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14358128-ee3b-46da-bc4d-23694a7b1ddc', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff56de3-4c2c-4d2b-845c-d842b598ab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:20 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a731fb39-f592-4a74-8905-e182809a75ef" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Volume volume-14358128-ee3b-46da-bc4d-23694a7b1ddc (14358128-ee3b-46da-bc4d-23694a7b1ddc): created successfully Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff56de3-4c2c-4d2b-845c-d842b598ab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Flow 'volume_create_manager' (fe681dc6-3365-41c4-92e8-8a5b3743ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-a731fb39-f592-4a74-8905-e182809a75ef" released by "delete_volume" :: held 0.901s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-eae9d34d-e3a1-45bf-bd08-0b9e1ad525f2 tempest-VolumesTestJSON-120731726 None] Created volume successfully. Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['dbc519f6-da4b-44de-b536-1173038f137f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:20 devstack cinder-volume[88999]: WARNING cinder.quota [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-137812999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-137812999, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:20 devstack cinder-volume[88999]: WARNING cinder.quota [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-137812999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-137812999, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:20 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD" returned: 0 in 0.457s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Temporary image 57f71d08-6087-4139-b5a9-668b08a6d5b4 is fetched for user 36a7363dd8e844a285da52e9ba71ab54. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['40890f27-afe3-4884-9f0a-a0cdcc168e96', '58d22a2c-d750-4fff-9440-47ebbeb696c6', 'af497d18-f319-4c4c-80fa-baf34b4e36bc', '94cecfb5-964b-41f4-acea-97c2ad0be139'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Flow 'volume_create_manager' (b1ea4d5a-742b-4062-885f-11801a37b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154a1af9-485d-418d-b6ea-a03804935f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154a1af9-485d-418d-b6ea-a03804935f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-13338063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3826074-89e1-4e16-b392-2d6abc138860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c31af13ad04db9b9b9d7c368e6b4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:20Z,use_quota=True,user_id='8124841bef934604bbe195684c964737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7261284d-eac8-4e62-ad8f-ae1c23e0d5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7261284d-eac8-4e62-ad8f-ae1c23e0d5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f27ed3e-f925-4064-a478-bf48f144e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f27ed3e-f925-4064-a478-bf48f144e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3826074-89e1-4e16-b392-2d6abc138860', 'volume_name': 'volume-f3826074-89e1-4e16-b392-2d6abc138860', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c1bd5-a46f-4c40-9017-19f19f2bc065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f8c1bd5-a46f-4c40-9017-19f19f2bc065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49832404-1eda-4f8d-b113-2b8f6fecc004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Volume f3826074-89e1-4e16-b392-2d6abc138860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3826074-89e1-4e16-b392-2d6abc138860', 'volume_size': 1} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-13338063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3826074-89e1-4e16-b392-2d6abc138860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c31af13ad04db9b9b9d7c368e6b4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:20Z,use_quota=True,user_id='8124841bef934604bbe195684c964737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Creating volume f3826074-89e1-4e16-b392-2d6abc138860 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:20 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:20 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 1073741824 Aug 05 15:41:20 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b2011f-c13a-45f7-9a3b-0cec31d1adf9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:20 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD Aug 05 15:41:20 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:20 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:20 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:21 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:21 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 1073741824" returned: 0 in 0.488s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:21 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.362s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-89e45f8a-0dd0-4ca0-add1-b7e86730e27c tempest-GroupSnapshotsTest-2040095227 None] Delete group completed successfully. Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:21 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 Aug 05 15:41:21 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:21 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1319744854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1859aa80-3f44-4546-b194-b343d1a9d3ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80efa18020cb4a0197f089a488afe18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:12Z,use_quota=True,user_id='36a7363dd8e844a285da52e9ba71ab54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca634934-1a01-4987-af74-efd34b86a249),volume_type_id=ca634934-1a01-4987-af74-efd34b86a249)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Creating volume 1859aa80-3f44-4546-b194-b343d1a9d3ea {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:21 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49832404-1eda-4f8d-b113-2b8f6fecc004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3826074-89e1-4e16-b392-2d6abc138860', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:21 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea 1073741824 Aug 05 15:41:21 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247f1a15-6ab8-4702-9c2a-7d60a7de29bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:21 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Volume volume-f3826074-89e1-4e16-b392-2d6abc138860 (f3826074-89e1-4e16-b392-2d6abc138860): created successfully Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (247f1a15-6ab8-4702-9c2a-7d60a7de29bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Flow 'volume_create_manager' (b1ea4d5a-742b-4062-885f-11801a37b115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-23c840f0-728c-4b85-b044-5cf1fe8880a7 tempest-VolumesTransfersTest-422284252 None] Created volume successfully. Aug 05 15:41:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] group_snapshot b366e33b-6b96-4113-8ed5-9fb5444dae2c: deleting Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Acquiring lock "cinder-14358128-ee3b-46da-bc4d-23694a7b1ddc-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Lock "cinder-14358128-ee3b-46da-bc4d-23694a7b1ddc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] group_snapshot b366e33b-6b96-4113-8ed5-9fb5444dae2c: deleting {{(pid=88999) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-f9d47553-9534-41a4-b38f-93d41f267866" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-f9d47553-9534-41a4-b38f-93d41f267866" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-29010c20-fd32-49d9-9de8-eb3ce6d7181e" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Acquiring lock "cinder-quobyte-14358128-ee3b-46da-bc4d-23694a7b1ddc" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-29010c20-fd32-49d9-9de8-eb3ce6d7181e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Deleting offline snapshot 29010c20-fd32-49d9-9de8-eb3ce6d7181e of volume f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] snapshot_file for this snap is: volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Lock "cinder-quobyte-14358128-ee3b-46da-bc4d-23694a7b1ddc" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09c2b1-416a-4317-a2ed-e8f4c1080ff5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c206ec32-9c62-4bac-9299-fda75cae8723]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:21 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea 1073741824" returned: 0 in 0.559s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:21 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e Aug 05 15:41:22 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc Aug 05 15:41:22 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea Aug 05 15:41:22 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:22 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:22 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e" returned: 0 in 0.430s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d47553-9534-41a4-b38f-93d41f267866(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:41:22 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc Aug 05 15:41:22 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Attempting download of 57f71d08-6087-4139-b5a9-668b08a6d5b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/57f71d08-6087-4139-b5a9-668b08a6d5b4', 'metadata': {}}])) to volume 1859aa80-3f44-4546-b194-b343d1a9d3ea. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e59f094-796a-4e94-9145-6047351dd000]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f770e94-33b2-42ee-b409-636363c9fc8b]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:22 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 Aug 05 15:41:22 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0 Aug 05 15:41:22 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14358128-ee3b-46da-bc4d-23694a7b1ddc" returned: 0 in 0.298s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Lock "cinder-quobyte-14358128-ee3b-46da-bc4d-23694a7b1ddc" released by "delete_volume" :: held 0.747s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Created reservations ['ac98d929-4002-487a-aede-3776b0e80332', 'bcb315de-a450-49c6-bc6a-7a5a7690d11f', '521df891-5632-4f5d-bee7-05b4f8da23a6', 'b19093ae-af5f-4cb9-8fa1-03268df1d1da'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:22 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:22 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:22 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0 Aug 05 15:41:22 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Acquiring lock "cinder-69435851-812a-4707-928c-7f857e4471e2-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:22 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866" returned: 0 in 0.650s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Lock "cinder-69435851-812a-4707-928c-7f857e4471e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:23 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e Aug 05 15:41:23 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Acquiring lock "cinder-quobyte-69435851-812a-4707-928c-7f857e4471e2" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Lock "cinder-quobyte-69435851-812a-4707-928c-7f857e4471e2" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0e404b-2c8d-409f-9f21-3976e55cae34]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:23 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.419s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Deleted volume successfully. Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e698ae53-bfe0-4854-8f59-eefedaf9550a tempest-VolumesTestJSON-120731726 None] Lock "cinder-14358128-ee3b-46da-bc4d-23694a7b1ddc-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:23 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0" returned: 1 in 0.480s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57f71d08-6087-4139-b5a9-668b08a6d5b4_4lgueko0' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b994581-6c08-42d8-900b-4304ec97d289]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:23 devstack sudo[98683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 Aug 05 15:41:23 devstack sudo[98683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:23 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD Aug 05 15:41:23 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-57e74d5e-9f12-4e3f-96b7-84929446f694 tempest-VolumesTransfersTest-1469618008 None] Transfer volume completed successfully. Aug 05 15:41:23 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e" returned: 0 in 0.555s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:23 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e Aug 05 15:41:23 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:23 devstack sudo[98683]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2" returned: 0 in 0.462s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:23 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2 Aug 05 15:41:23 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:23 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] 57f71d08-6087-4139-b5a9-668b08a6d5b4 was qcow2, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:23 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea Aug 05 15:41:23 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:23 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866.29010c20-fd32-49d9-9de8-eb3ce6d7181e" returned: 0 in 0.311s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-29010c20-fd32-49d9-9de8-eb3ce6d7181e" released by "_delete_snapshot" :: held 2.059s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-f9d47553-9534-41a4-b38f-93d41f267866" released by "delete_snapshot" :: held 2.085s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:23 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-69435851-812a-4707-928c-7f857e4471e2" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Lock "cinder-quobyte-69435851-812a-4707-928c-7f857e4471e2" released by "delete_volume" :: held 0.839s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:23 devstack cinder-volume[88999]: WARNING cinder.quota [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-137812999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-137812999, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Created reservations ['9635d1ca-80f8-4488-b205-d93509f4eb14', '9efc4e06-dd72-4289-a16e-53d830259033', 'cd9b61da-8d0d-4d1d-93c8-4fd4786d9766', '82d2143f-fb6a-4b91-90c0-22b17a6c4de6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Acquiring lock "cinder-f3826074-89e1-4e16-b392-2d6abc138860-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['0b359e36-2092-4a43-8930-74fbb00ebf8d', '10e70e44-8fdb-4d0b-a281-3b56610e99bb', 'b0dcf66d-83de-43ac-84c1-4c1bc4b52cbe', '2c860f57-398d-4ee9-9d59-8e322f190bd5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Lock "cinder-f3826074-89e1-4e16-b392-2d6abc138860-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Acquiring lock "cinder-quobyte-f3826074-89e1-4e16-b392-2d6abc138860" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:24 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:24 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Acquiring lock "cinder-bcf4872c-f873-4d31-9acd-5aa1f0c04584-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Lock "cinder-quobyte-f3826074-89e1-4e16-b392-2d6abc138860" acquired by "delete_volume" :: waited 0.070s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Lock "cinder-bcf4872c-f873-4d31-9acd-5aa1f0c04584-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fbb93c-76d4-4539-8959-f4f908027e1a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:24 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-aefb8d5f-4d8f-4941-9c4e-1468b4eb1b8b tempest-GroupSnapshotsTest-2040095227 None] group_snapshot b366e33b-6b96-4113-8ed5-9fb5444dae2c: deleted successfully Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Acquiring lock "cinder-quobyte-bcf4872c-f873-4d31-9acd-5aa1f0c04584" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Lock "cinder-quobyte-bcf4872c-f873-4d31-9acd-5aa1f0c04584" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c1762-aca8-46f5-b174-3e7c0c20edbc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:24 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 Aug 05 15:41:24 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:24 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.332s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:24 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Deleted volume successfully. Aug 05 15:41:24 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 Aug 05 15:41:24 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6ebcf767-8733-45b7-ba14-40b6d8f88892 tempest-VolumesTestJSON-120731726 None] Lock "cinder-69435851-812a-4707-928c-7f857e4471e2-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:24 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860" returned: 0 in 0.519s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:24 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:24 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860 Aug 05 15:41:24 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584" returned: 0 in 0.446s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:24 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584 Aug 05 15:41:24 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:25 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3826074-89e1-4e16-b392-2d6abc138860" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Lock "cinder-quobyte-f3826074-89e1-4e16-b392-2d6abc138860" released by "delete_volume" :: held 0.879s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:25 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bcf4872c-f873-4d31-9acd-5aa1f0c04584" returned: 0 in 0.292s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Lock "cinder-quobyte-bcf4872c-f873-4d31-9acd-5aa1f0c04584" released by "delete_volume" :: held 0.793s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Created reservations ['4ab5ba7e-799e-473b-828e-5e5d01a9521b', '0d9bede5-3b80-419b-a693-bc403608582a', 'c8f158ac-6d0c-43b4-af9d-cbadf1b04b8a', '8896a8a1-18a6-4f78-8a45-73a2c0287192'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Created reservations ['61e981f8-1f9b-45c0-af2d-7402209d9e8c', '40024ccb-ca32-4ec8-a752-54b73ab1870e', '996890d5-83bc-4508-802a-e9e02e78776e', '890dc93d-2443-4022-b4ad-2bfbfa93c68c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:25 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:25 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:25 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:25 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-f9d47553-9534-41a4-b38f-93d41f267866" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-f9d47553-9534-41a4-b38f-93d41f267866" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:25 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Deleted volume successfully. Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[97714218-e2fa-4235-ad36-944ca268814a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4769eff8-a7d0-4aab-be85-c40e703b8a02 tempest-VolumesTransfersTest-501294478 None] Lock "cinder-f3826074-89e1-4e16-b392-2d6abc138860-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:25 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 Aug 05 15:41:25 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:25 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.456s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Deleted volume successfully. Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ce89d944-60dd-468e-bde8-c45adc2955f7 tempest-VolumesTestJSON-120731726 None] Lock "cinder-bcf4872c-f873-4d31-9acd-5aa1f0c04584-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:25 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea" returned: 0 in 2.267s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57f71d08-6087-4139-b5a9-668b08a6d5b4_cres49czdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:41:25 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Converted 112.00 MB image at 49.38 MB/s Aug 05 15:41:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:25 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea 1G Aug 05 15:41:25 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:26 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866" returned: 0 in 0.430s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:26 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866 Aug 05 15:41:26 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:26 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea 1G" returned: 0 in 0.380s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Downloaded image 57f71d08-6087-4139-b5a9-668b08a6d5b4 ((None, [{'url': 'file:///opt/stack/data/glance/images/57f71d08-6087-4139-b5a9-668b08a6d5b4', 'metadata': {}}])) to volume 1859aa80-3f44-4546-b194-b343d1a9d3ea successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Temporary image 57f71d08-6087-4139-b5a9-668b08a6d5b4 for user 36a7363dd8e844a285da52e9ba71ab54 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Marking volume 1859aa80-3f44-4546-b194-b343d1a9d3ea as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Copying metadata from image 57f71d08-6087-4139-b5a9-668b08a6d5b4 to 1859aa80-3f44-4546-b194-b343d1a9d3ea. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Creating volume glance metadata for volume 1859aa80-3f44-4546-b194-b343d1a9d3ea backed by image 57f71d08-6087-4139-b5a9-668b08a6d5b4 with: {'image_id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'image_name': 'tempest-scenario-img--534047732', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849135a2-f6dc-46e0-a9ce-663da630df2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1859aa80-3f44-4546-b194-b343d1a9d3ea', 'volume_size': 1, 'image_id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57f71d08-6087-4139-b5a9-668b08a6d5b4', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--534047732', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80efa18020cb4a0197f089a488afe18c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57f71d08-6087-4139-b5a9-668b08a6d5b4', 'created_at': datetime.datetime(2026, 8, 5, 13, 41, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 41, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57f71d08-6087-4139-b5a9-668b08a6d5b4/file', 'properties': {}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:26 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2706cd85-089b-47e4-b2cd-fb0af74e9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f9d47553-9534-41a4-b38f-93d41f267866" returned: 0 in 0.314s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Volume volume-1859aa80-3f44-4546-b194-b343d1a9d3ea (1859aa80-3f44-4546-b194-b343d1a9d3ea): created successfully Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2706cd85-089b-47e4-b2cd-fb0af74e9eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Flow 'volume_create_manager' (10d10820-9cb6-4487-9a33-9de23f858924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-f9d47553-9534-41a4-b38f-93d41f267866" released by "delete_volume" :: held 0.871s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-db2a7cb0-396b-4874-a8dc-1ea87cf85383 tempest-TestInstancesWithCinderVolumes-1806207960 None] Created volume successfully. Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['8fab7b09-fcaf-447f-aa06-efa2ca57aff5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:26 devstack cinder-volume[88999]: WARNING cinder.db.api [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-137812999'] Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['7d037321-198b-400e-b787-4dca4e8581e1', '0fb764cc-f4b2-4f3a-aa38-3faf75d65130', '3103d8b3-5b61-4382-bf45-6a0a244528ae', 'ac37343b-7bd7-438d-a78d-aced5a0fac2f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:26 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:26 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Flow 'volume_create_manager' (51ae7d8a-6afc-4d50-8069-6a9a4e24d0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c029a4a-daed-4f2d-a273-35e5042bdc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c029a4a-daed-4f2d-a273-35e5042bdc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888052357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7ec1e0-dd98-4783-80a2-542b7bbb3630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c31af13ad04db9b9b9d7c368e6b4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:27Z,use_quota=True,user_id='8124841bef934604bbe195684c964737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a51babd-c74b-4e05-9c23-c2990958d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a51babd-c74b-4e05-9c23-c2990958d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8682ec65-c975-4b14-8c1a-bdb9f7ac075e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:27 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8682ec65-c975-4b14-8c1a-bdb9f7ac075e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7ec1e0-dd98-4783-80a2-542b7bbb3630', 'volume_name': 'volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31588f21-db24-4aac-9da3-04e599aaf9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31588f21-db24-4aac-9da3-04e599aaf9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e61034f-66c3-4e5f-815b-64675a51f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Volume 2b7ec1e0-dd98-4783-80a2-542b7bbb3630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630', 'volume_size': 1} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-888052357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7ec1e0-dd98-4783-80a2-542b7bbb3630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3c31af13ad04db9b9b9d7c368e6b4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:27Z,use_quota=True,user_id='8124841bef934604bbe195684c964737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Creating volume 2b7ec1e0-dd98-4783-80a2-542b7bbb3630 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.422s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-59b589c3-dcf8-4713-a5f5-3f1cd05b966a tempest-GroupSnapshotsTest-2040095227 None] Delete group completed successfully. Aug 05 15:41:27 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 1073741824 Aug 05 15:41:27 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:27 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 1073741824" returned: 0 in 0.508s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:27 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 Aug 05 15:41:27 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:28 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630" returned: 0 in 0.507s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e61034f-66c3-4e5f-815b-64675a51f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99637bc-6a0f-4d07-b9a4-4cfc4d5ee2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Volume volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 (2b7ec1e0-dd98-4783-80a2-542b7bbb3630): created successfully Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99637bc-6a0f-4d07-b9a4-4cfc4d5ee2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Flow 'volume_create_manager' (51ae7d8a-6afc-4d50-8069-6a9a4e24d0a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9996734f-ee6d-46d6-85b2-ec334c225c1d tempest-VolumesTransfersTest-422284252 None] Created volume successfully. Aug 05 15:41:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c7222e0a-93cc-4532-8421-3cdda494d89d tempest-GroupSnapshotsTest-2040095227 None] Group tempest-GroupSnapshotsTest-Group-1441564621: creating Aug 05 15:41:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c7222e0a-93cc-4532-8421-3cdda494d89d tempest-GroupSnapshotsTest-2040095227 None] Group tempest-GroupSnapshotsTest-Group-1441564621: created successfully Aug 05 15:41:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c7222e0a-93cc-4532-8421-3cdda494d89d tempest-GroupSnapshotsTest-2040095227 None] Create group completed successfully. Aug 05 15:41:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Acquiring lock "cinder-2b7ec1e0-dd98-4783-80a2-542b7bbb3630-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Lock "cinder-2b7ec1e0-dd98-4783-80a2-542b7bbb3630-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Acquiring lock "cinder-quobyte-2b7ec1e0-dd98-4783-80a2-542b7bbb3630" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Lock "cinder-quobyte-2b7ec1e0-dd98-4783-80a2-542b7bbb3630" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[315b42be-547f-4b60-8eba-4a03dea88f55]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:29 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 Aug 05 15:41:29 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-17a28aed-2ae7-40a3-9606-05492657421b req-6eb1ba46-e96d-4446-9c12-b50b76ff6992 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-17a28aed-2ae7-40a3-9606-05492657421b req-6eb1ba46-e96d-4446-9c12-b50b76ff6992 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-17a28aed-2ae7-40a3-9606-05492657421b req-6eb1ba46-e96d-4446-9c12-b50b76ff6992 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-17a28aed-2ae7-40a3-9606-05492657421b req-6eb1ba46-e96d-4446-9c12-b50b76ff6992 tempest-TestInstancesWithCinderVolumes-1806207960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-1859aa80-3f44-4546-b194-b343d1a9d3ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd63c992b-4d2a-4eab-b3e6-5d11cd9bf17d', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:41:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-17a28aed-2ae7-40a3-9606-05492657421b req-6eb1ba46-e96d-4446-9c12-b50b76ff6992 tempest-TestInstancesWithCinderVolumes-1806207960 None] attachment_update completed successfully. Aug 05 15:41:30 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630" returned: 0 in 0.644s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:30 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630 Aug 05 15:41:30 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:30 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2b7ec1e0-dd98-4783-80a2-542b7bbb3630" returned: 0 in 0.477s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Lock "cinder-quobyte-2b7ec1e0-dd98-4783-80a2-542b7bbb3630" released by "delete_volume" :: held 1.210s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (b8a12200-2dc9-47f6-8166-3189fe43ddcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08beeac-0d2c-4dad-b6a8-8a598fb5d402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:30 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Created reservations ['ea0fbdb9-3721-44ef-b165-b6e0b58584ed', '91ec7683-a33c-48ff-867f-d168ee936ae5', '37ec3912-336b-4005-ace7-fafaafa1c12d', 'ad8d8b5d-68a2-4250-b4b6-7ebae9dee932'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08beeac-0d2c-4dad-b6a8-8a598fb5d402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-462266129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0748b13d-d780-41b1-9f1b-24d1d9476da7,host='devstack@QuobyteHD#QuobyteHD',id=6b45c2c9-210e-4ed2-8ceb-426332a27fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:31Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fab48-25eb-44dd-8ebd-255ae09a01a3),volume_type_id=0d5fab48-25eb-44dd-8ebd-255ae09a01a3)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb19747-942b-4d19-8566-69de4a8bbd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb19747-942b-4d19-8566-69de4a8bbd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a65c26f-9508-42f9-a923-bcbeada040fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a65c26f-9508-42f9-a923-bcbeada040fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b45c2c9-210e-4ed2-8ceb-426332a27fda', 'volume_name': 'volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2289e43b-f009-49e5-899d-a62c835c5faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2289e43b-f009-49e5-899d-a62c835c5faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c086557-f40a-40e1-9ded-08552b79da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Volume 6b45c2c9-210e-4ed2-8ceb-426332a27fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda', 'volume_size': 1} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0748b13d-d780-41b1-9f1b-24d1d9476da7,created_at=2026-08-05T13:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-462266129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0748b13d-d780-41b1-9f1b-24d1d9476da7,host='devstack@QuobyteHD#QuobyteHD',id=6b45c2c9-210e-4ed2-8ceb-426332a27fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:31Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fab48-25eb-44dd-8ebd-255ae09a01a3),volume_type_id=0d5fab48-25eb-44dd-8ebd-255ae09a01a3)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Creating volume 6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:31 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-462e05da-9f47-4efe-8325-7ba8d4e7dd82 tempest-BackendsCapabilitiesAdminTestsJSON-703135638 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940155029297, 'free_capacity_gb': 1775.6940155029297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88999) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 15:41:31 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda 1073741824 Aug 05 15:41:31 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9db44ec9-635e-482b-aafd-f8bd6613d966 tempest-BackendsCapabilitiesAdminTestsJSON-703135638 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940155029297, 'free_capacity_gb': 1775.6940155029297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88999) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:31 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:31 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:31 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.305s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Deleted volume successfully. Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-57a1434b-1ab4-4eef-a6ad-01131d3b294c tempest-VolumesTransfersTest-501294478 None] Lock "cinder-2b7ec1e0-dd98-4783-80a2-542b7bbb3630-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:31 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda 1073741824" returned: 0 in 0.561s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:31 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda Aug 05 15:41:31 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:32 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c086557-f40a-40e1-9ded-08552b79da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fae0c6-e470-4918-8130-5a40ee36b61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Volume volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda (6b45c2c9-210e-4ed2-8ceb-426332a27fda): created successfully Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18fae0c6-e470-4918-8130-5a40ee36b61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (b8a12200-2dc9-47f6-8166-3189fe43ddcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3ca4d4d1-3e32-4f4d-a80b-dc3929790ea1 tempest-GroupSnapshotsTest-2040095227 None] Created volume successfully. Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (8f257ef2-028c-4dd6-abbb-c29d9e5327b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46a2ad-667f-4c11-8ac1-199986cc0249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f46a2ad-667f-4c11-8ac1-199986cc0249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814823487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0748b13d-d780-41b1-9f1b-24d1d9476da7,host='devstack@QuobyteHD#QuobyteHD',id=cb0e62a7-91d5-4853-aa17-bfbb7e859410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:33Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fab48-25eb-44dd-8ebd-255ae09a01a3),volume_type_id=0d5fab48-25eb-44dd-8ebd-255ae09a01a3)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0d3d67-5468-48b6-8d7b-55dd035c1ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a0d3d67-5468-48b6-8d7b-55dd035c1ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adccae28-7b50-4996-a31e-8451dede6db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adccae28-7b50-4996-a31e-8451dede6db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb0e62a7-91d5-4853-aa17-bfbb7e859410', 'volume_name': 'volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6245592-0d87-4c27-ad6c-d5cad5a5b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6245592-0d87-4c27-ad6c-d5cad5a5b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e361d28-04bd-402c-856a-bccffa8352c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Volume cb0e62a7-91d5-4853-aa17-bfbb7e859410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410', 'volume_size': 1} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0748b13d-d780-41b1-9f1b-24d1d9476da7,created_at=2026-08-05T13:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1814823487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0748b13d-d780-41b1-9f1b-24d1d9476da7,host='devstack@QuobyteHD#QuobyteHD',id=cb0e62a7-91d5-4853-aa17-bfbb7e859410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:33Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d5fab48-25eb-44dd-8ebd-255ae09a01a3),volume_type_id=0d5fab48-25eb-44dd-8ebd-255ae09a01a3)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Creating volume cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:33 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:33 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 1073741824 Aug 05 15:41:33 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:34 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 1073741824" returned: 0 in 0.929s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:34 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 Aug 05 15:41:34 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:34 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410" returned: 0 in 0.481s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e361d28-04bd-402c-856a-bccffa8352c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834bf9a5-89fa-427e-b289-0269493155c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Volume volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 (cb0e62a7-91d5-4853-aa17-bfbb7e859410): created successfully Aug 05 15:41:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834bf9a5-89fa-427e-b289-0269493155c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (8f257ef2-028c-4dd6-abbb-c29d9e5327b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7d32b9e2-da15-4f69-a324-b91f74ee7f01 tempest-GroupSnapshotsTest-2040095227 None] Created volume successfully. Aug 05 15:41:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7cdbb545-4887-48cc-9fbf-55b864db9d25 tempest-GroupSnapshotsTest-2040095227 None] Update group completed successfully. Aug 05 15:41:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fee48bab-c08d-4f6d-9feb-2f8f00c345d0 tempest-GroupSnapshotsTest-2040095227 None] Update group completed successfully. Aug 05 15:41:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-54cb4a58-9b3b-4111-aed9-e9b0996fcb1e tempest-GroupSnapshotsTest-2040095227 None] Update group completed successfully. Aug 05 15:41:40 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3e12fef1-b2cf-481f-9ca2-c444af8a021d tempest-GroupSnapshotsTest-2040095227 None] Update group completed successfully. Aug 05 15:41:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] GroupSnapshot 76e5bc02-a1e7-4290-b49c-af23e9360744: creating. Aug 05 15:41:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Group snapshot 76e5bc02-a1e7-4290-b49c-af23e9360744: creating. {{(pid=88999) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:41:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Creating offline snapshot 2166a814-4708-464d-a35c-6ccebd043f0a of volume cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:41:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d09e2b5-ac04-484f-bd05-be134e230f81]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:42 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 Aug 05 15:41:42 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:42 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410" returned: 0 in 0.534s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:42 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a 1G Aug 05 15:41:42 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:43 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a 1G" returned: 0 in 0.763s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:43 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a Aug 05 15:41:43 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:43 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a" returned: 0 in 0.362s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:43 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:43 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a Aug 05 15:41:43 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:43 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:44 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info Aug 05 15:41:44 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:44 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info" returned: 0 in 0.302s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:44 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:44 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info Aug 05 15:41:44 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:44 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.info" returned: 0 in 0.539s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.037s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Creating offline snapshot 2e03a053-5367-4b02-8fe5-7ffaa173f670 of volume 6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:41:45 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de4a69-8e77-4cb9-8b7b-0ede53e51d7e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:45 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda Aug 05 15:41:45 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:46 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda" returned: 0 in 1.093s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:46 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 1G Aug 05 15:41:46 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:46 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 1G" returned: 0 in 0.693s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:46 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 Aug 05 15:41:46 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:47 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670" returned: 0 in 0.465s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:47 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:47 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 Aug 05 15:41:47 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:47 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670" returned: 0 in 0.393s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:47 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info Aug 05 15:41:47 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:48 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info" returned: 0 in 0.437s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:48 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:41:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:48 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info Aug 05 15:41:48 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:48 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.info" returned: 0 in 0.425s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.703s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-83d7995a-e03a-422d-8493-35fe388c3097 tempest-GroupSnapshotsTest-2040095227 None] group_snapshot 76e5bc02-a1e7-4290-b49c-af23e9360744: created successfully Aug 05 15:41:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] group_snapshot 76e5bc02-a1e7-4290-b49c-af23e9360744: deleting Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] group_snapshot 76e5bc02-a1e7-4290-b49c-af23e9360744: deleting {{(pid=88999) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-cb0e62a7-91d5-4853-aa17-bfbb7e859410" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-cb0e62a7-91d5-4853-aa17-bfbb7e859410" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-2166a814-4708-464d-a35c-6ccebd043f0a" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-2166a814-4708-464d-a35c-6ccebd043f0a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Deleting offline snapshot 2166a814-4708-464d-a35c-6ccebd043f0a of volume cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] snapshot_file for this snap is: volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4674ab-b0fa-47e6-8440-5a93d12dd887]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Flow 'volume_create_manager' (268b9f69-8747-42f0-8d31-0358753f3b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:50 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a Aug 05 15:41:50 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf60d25-a2a5-4f02-9a58-e796c5a990d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf60d25-a2a5-4f02-9a58-e796c5a990d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1798982433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cf4d4d-e6ee-42b5-b897-16375d533926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bdeceb698b4325a2fedc1063ea7b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:50Z,use_quota=True,user_id='51e224ddeab14deab7ef72fe74cdbc7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ed73701-2b80-4e33-a2d3-b6cbeff635b5),volume_type_id=8ed73701-2b80-4e33-a2d3-b6cbeff635b5)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46d0db5-8afc-4778-8e2f-8fd1c729e4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46d0db5-8afc-4778-8e2f-8fd1c729e4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778ba678-aa93-4142-a81d-e478fbd2e869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778ba678-aa93-4142-a81d-e478fbd2e869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1cf4d4d-e6ee-42b5-b897-16375d533926', 'volume_name': 'volume-d1cf4d4d-e6ee-42b5-b897-16375d533926', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62814c15-8db6-403f-9fc3-f0c0b9a573a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62814c15-8db6-403f-9fc3-f0c0b9a573a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f031cba7-b75d-4eff-8f01-5638cdc8c62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Volume d1cf4d4d-e6ee-42b5-b897-16375d533926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1cf4d4d-e6ee-42b5-b897-16375d533926', 'volume_size': 1} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1798982433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1cf4d4d-e6ee-42b5-b897-16375d533926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bdeceb698b4325a2fedc1063ea7b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:50Z,use_quota=True,user_id='51e224ddeab14deab7ef72fe74cdbc7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ed73701-2b80-4e33-a2d3-b6cbeff635b5),volume_type_id=8ed73701-2b80-4e33-a2d3-b6cbeff635b5)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Creating volume d1cf4d4d-e6ee-42b5-b897-16375d533926 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:50 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:50 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 1073741824 Aug 05 15:41:50 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:50 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a" returned: 0 in 1.089s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[139ed2fb-3c1b-4ebc-92ad-806ce9ac1375]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:51 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 1073741824" returned: 0 in 0.756s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:51 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 Aug 05 15:41:51 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:51 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 Aug 05 15:41:51 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:51 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f031cba7-b75d-4eff-8f01-5638cdc8c62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1cf4d4d-e6ee-42b5-b897-16375d533926', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:51 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a199ce-a60a-4892-9d6b-b9aa5ef8da9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410" returned: 0 in 0.646s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:51 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a Aug 05 15:41:51 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:51 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Volume volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 (d1cf4d4d-e6ee-42b5-b897-16375d533926): created successfully Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a199ce-a60a-4892-9d6b-b9aa5ef8da9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Flow 'volume_create_manager' (268b9f69-8747-42f0-8d31-0358753f3b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-75b377ab-6dde-4956-a29a-76bf373065e0 tempest-VolumeTypesAccessTest-115330647 None] Created volume successfully. Aug 05 15:41:52 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a" returned: 0 in 0.694s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Acquiring lock "cinder-d1cf4d4d-e6ee-42b5-b897-16375d533926-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:52 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a Aug 05 15:41:52 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Lock "cinder-d1cf4d4d-e6ee-42b5-b897-16375d533926-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Acquiring lock "cinder-quobyte-d1cf4d4d-e6ee-42b5-b897-16375d533926" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Lock "cinder-quobyte-d1cf4d4d-e6ee-42b5-b897-16375d533926" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de054e8-9e5b-48ee-bb48-4692450be6c4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:52 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410.2166a814-4708-464d-a35c-6ccebd043f0a" returned: 0 in 0.400s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:52 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 Aug 05 15:41:52 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-2166a814-4708-464d-a35c-6ccebd043f0a" released by "_delete_snapshot" :: held 3.009s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-cb0e62a7-91d5-4853-aa17-bfbb7e859410" released by "delete_snapshot" :: held 3.055s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-6b45c2c9-210e-4ed2-8ceb-426332a27fda" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-6b45c2c9-210e-4ed2-8ceb-426332a27fda" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-2e03a053-5367-4b02-8fe5-7ffaa173f670" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-2e03a053-5367-4b02-8fe5-7ffaa173f670" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Deleting offline snapshot 2e03a053-5367-4b02-8fe5-7ffaa173f670 of volume 6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:41:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] snapshot_file for this snap is: volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51ab2d-ef7e-4fe8-9f94-45d5c3d678ca]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:53 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 Aug 05 15:41:53 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:53 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926" returned: 0 in 0.530s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:53 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926 Aug 05 15:41:53 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:53 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:53 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d1cf4d4d-e6ee-42b5-b897-16375d533926" returned: 0 in 0.350s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670" returned: 0 in 0.560s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Lock "cinder-quobyte-d1cf4d4d-e6ee-42b5-b897-16375d533926" released by "delete_volume" :: held 1.003s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[601b3064-fb6b-43be-8ec9-8e07af89f5f8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:53 devstack cinder-volume[88999]: WARNING cinder.quota [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-115433047 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-115433047, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:53 devstack cinder-volume[88999]: WARNING cinder.quota [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-115433047 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-115433047, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Created reservations ['26d637c2-f06c-4441-96de-6e2155c92d50', '12b8fb00-d121-4a77-962c-a75e0014d4da', 'bd14b762-c769-424e-a4ba-2e4c1720c70f', 'ab477574-b8f0-4c0f-9915-72ff24496a38'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:53 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda Aug 05 15:41:53 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:53 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:53 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:54 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.383s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Deleted volume successfully. Aug 05 15:41:54 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda" returned: 0 in 0.637s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-29e93a00-ba97-4bcf-b462-44a670c59d6c tempest-VolumeTypesAccessTest-115330647 None] Lock "cinder-d1cf4d4d-e6ee-42b5-b897-16375d533926-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:54 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 Aug 05 15:41:54 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:54 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670" returned: 0 in 0.624s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:54 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670 Aug 05 15:41:54 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:55 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda.2e03a053-5367-4b02-8fe5-7ffaa173f670" returned: 0 in 0.312s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-2e03a053-5367-4b02-8fe5-7ffaa173f670" released by "_delete_snapshot" :: held 2.325s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-6b45c2c9-210e-4ed2-8ceb-426332a27fda" released by "delete_snapshot" :: held 2.372s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=134,cinder:UPDATE=167,cinder:DELETE=11,cinder:INSERT=38 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=158,cinder:INSERT=43,cinder:UPDATE=158,cinder:DELETE=12 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:41:55 devstack cinder-volume[88999]: WARNING cinder.quota [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-710794539 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-710794539, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:55 devstack cinder-volume[88999]: WARNING cinder.quota [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-710794539 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-710794539, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['78ce1ba5-a23e-4014-b116-334133bddd40', '188838bf-7dae-40fc-933b-5e89700805ea', 'd6bbc925-6362-491d-b49d-366cf96702fc', '0739a978-7774-409e-8012-803f8a28763f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['bec4dd92-b1bb-46fc-b62f-ee35686133a6', '2f11ece4-f2ff-4759-be76-6315140f3858', '3e0ca07f-b67e-475e-beda-2c22b7e4a260', '584da8fd-35c9-4533-94e0-5638d116a8db'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ad42ddc9-8ab1-4a94-bde7-e97481e0cf56 tempest-GroupSnapshotsTest-2040095227 None] group_snapshot 76e5bc02-a1e7-4290-b49c-af23e9360744: deleted successfully Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Flow 'volume_create_manager' (0c0b16c6-eb18-4511-9a46-30b09aed1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7452b7-c016-4466-81af-4ce0f52fed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7452b7-c016-4466-81af-4ce0f52fed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-703923026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c65aef1-b202-4281-bcc6-97c8e2a6c2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15282ea23da840c1ba8bcb18a6535d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:56Z,use_quota=True,user_id='4adac8d8b8cb4dbf966e91a4f4703d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ec2e46-4c52-4b75-9bc8-f6c2304039e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ec2e46-4c52-4b75-9bc8-f6c2304039e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275ebdac-582c-4aaa-9323-7ec5677d5c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275ebdac-582c-4aaa-9323-7ec5677d5c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c65aef1-b202-4281-bcc6-97c8e2a6c2b9', 'volume_name': 'volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5dfa0b-4fe9-4d2e-9b61-4f41024ae231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5dfa0b-4fe9-4d2e-9b61-4f41024ae231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b01b172-2bcb-496b-a90f-929945c3e76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Volume 0c65aef1-b202-4281-bcc6-97c8e2a6c2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9', 'volume_size': 1} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-703923026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c65aef1-b202-4281-bcc6-97c8e2a6c2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15282ea23da840c1ba8bcb18a6535d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:41:56Z,use_quota=True,user_id='4adac8d8b8cb4dbf966e91a4f4703d0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Creating volume 0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:41:56 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:56 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 1073741824 Aug 05 15:41:56 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-6b45c2c9-210e-4ed2-8ceb-426332a27fda" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-6b45c2c9-210e-4ed2-8ceb-426332a27fda" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[44717d14-8678-4b4e-93aa-8c5c47561e66]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:56 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 1073741824" returned: 0 in 0.487s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:56 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda Aug 05 15:41:56 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:56 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:41:56 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:56 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.281s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b01b172-2bcb-496b-a90f-929945c3e76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e85122-2c54-49e4-a944-794ee3fa4871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:41:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Volume volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 (0c65aef1-b202-4281-bcc6-97c8e2a6c2b9): created successfully Aug 05 15:41:56 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e85122-2c54-49e4-a944-794ee3fa4871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Flow 'volume_create_manager' (0c0b16c6-eb18-4511-9a46-30b09aed1bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda" returned: 0 in 0.452s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9dcac633-3e50-4205-8cc4-0a3a7dd2572a tempest-VolumesActionsTest-114127195 None] Created volume successfully. Aug 05 15:41:56 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda Aug 05 15:41:56 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:57 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6b45c2c9-210e-4ed2-8ceb-426332a27fda" returned: 0 in 0.255s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-6b45c2c9-210e-4ed2-8ceb-426332a27fda" released by "delete_volume" :: held 0.764s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-cb0e62a7-91d5-4853-aa17-bfbb7e859410" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-cb0e62a7-91d5-4853-aa17-bfbb7e859410" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d8f8a2-8781-48a2-a3d4-aedf9f4752d1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:57 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 Aug 05 15:41:57 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:57 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410" returned: 0 in 0.382s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:57 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410 Aug 05 15:41:57 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:57 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cb0e62a7-91d5-4853-aa17-bfbb7e859410" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-cb0e62a7-91d5-4853-aa17-bfbb7e859410" released by "delete_volume" :: held 0.737s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['0a9d8c4a-37d0-498b-b741-32540553cc58'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:58 devstack cinder-volume[88999]: WARNING cinder.quota [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-710794539 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-710794539, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['3ab73d48-8104-4e33-bc66-050cb707c4d1', '74118de7-c3e0-41cb-8c06-c1070ba11e17', 'd6b9bfc0-ce29-4070-a7a4-b34fae49714b', '3e0ff0ba-3716-4573-a391-846a6597be92'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['ff255d53-dd12-4216-b55a-bd6e27cd5621', 'c53b263e-73bf-416c-8b56-e38ff05cf215', 'd00b8eeb-55ca-461b-a79f-6a5ccb99500d', '467a664e-3821-4abe-8867-7d585d4f2b4c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:41:58 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:41:58 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:41:58 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.283s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:41:58 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:41:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3079cef7-5e4c-4fb5-9684-871079c19685 tempest-GroupSnapshotsTest-2040095227 None] Delete group completed successfully. Aug 05 15:41:59 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-38643f82-6db2-49e1-94ae-c65172c07132 tempest-GroupSnapshotsTest-2040095227 None] Group tempest-GroupSnapshotsTest-Group-1178841237: creating Aug 05 15:41:59 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-38643f82-6db2-49e1-94ae-c65172c07132 tempest-GroupSnapshotsTest-2040095227 None] Group tempest-GroupSnapshotsTest-Group-1178841237: created successfully Aug 05 15:41:59 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-38643f82-6db2-49e1-94ae-c65172c07132 tempest-GroupSnapshotsTest-2040095227 None] Create group completed successfully. Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (b6b762c6-1934-4c26-beef-de761d238cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189d21c5-a4ff-4132-a2da-832a97dceef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189d21c5-a4ff-4132-a2da-832a97dceef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1585988710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e77ef7b-8b8e-474f-9679-840368069caa,host='devstack@QuobyteHD#QuobyteHD',id=b89128c2-f901-4454-b49e-d31f2a314960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:42:01Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9583d1b-589a-48cc-b83c-16ff51fcaf23),volume_type_id=e9583d1b-589a-48cc-b83c-16ff51fcaf23)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7197e75d-41ff-49bf-a236-479c8a975a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7197e75d-41ff-49bf-a236-479c8a975a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14b422b-3021-4fc0-a754-8fca5662aed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14b422b-3021-4fc0-a754-8fca5662aed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89128c2-f901-4454-b49e-d31f2a314960', 'volume_name': 'volume-b89128c2-f901-4454-b49e-d31f2a314960', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c01fea6-a1a3-46a8-84ad-40babbbcc635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c01fea6-a1a3-46a8-84ad-40babbbcc635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a885bd8-f79a-4663-95ff-3d52c88fed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:01 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Volume b89128c2-f901-4454-b49e-d31f2a314960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89128c2-f901-4454-b49e-d31f2a314960', 'volume_size': 1} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7e77ef7b-8b8e-474f-9679-840368069caa,created_at=2026-08-05T13:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1585988710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7e77ef7b-8b8e-474f-9679-840368069caa,host='devstack@QuobyteHD#QuobyteHD',id=b89128c2-f901-4454-b49e-d31f2a314960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28c82ed7388a429bad41cc9264e32c8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:42:01Z,use_quota=True,user_id='1bc06b4914634f708005064939d80c6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9583d1b-589a-48cc-b83c-16ff51fcaf23),volume_type_id=e9583d1b-589a-48cc-b83c-16ff51fcaf23)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Creating volume b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:42:01 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:42:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:01 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 1073741824 Aug 05 15:42:01 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:02 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 1073741824" returned: 0 in 0.559s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:02 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 Aug 05 15:42:02 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:02 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a885bd8-f79a-4663-95ff-3d52c88fed63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89128c2-f901-4454-b49e-d31f2a314960', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c67b9-8062-488a-ad20-7c188978725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:02 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Volume volume-b89128c2-f901-4454-b49e-d31f2a314960 (b89128c2-f901-4454-b49e-d31f2a314960): created successfully Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b2c67b9-8062-488a-ad20-7c188978725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Flow 'volume_create_manager' (b6b762c6-1934-4c26-beef-de761d238cec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:42:02 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9bf76636-8c64-4352-9f89-e9f267b8cdf1 tempest-GroupSnapshotsTest-2040095227 None] Created volume successfully. Aug 05 15:42:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] GroupSnapshot e1a72e8c-997c-4c2e-8d8f-56a269ee362b: creating. Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Group snapshot e1a72e8c-997c-4c2e-8d8f-56a269ee362b: creating. {{(pid=88999) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Creating offline snapshot b7f1baea-3977-4c83-ab0d-a0db63f13dae of volume b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f450ca7a-8168-4db8-926c-94904f9b468e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:03 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 Aug 05 15:42:03 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:03 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960" returned: 0 in 0.534s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:03 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae 1G Aug 05 15:42:03 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:04 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae 1G" returned: 0 in 0.929s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89128c2-f901-4454-b49e-d31f2a314960 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:04 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89128c2-f901-4454-b49e-d31f2a314960 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae Aug 05 15:42:04 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:05 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b89128c2-f901-4454-b49e-d31f2a314960 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae" returned: 0 in 0.845s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:05 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:42:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:05 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae Aug 05 15:42:05 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:05 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae" returned: 0 in 0.352s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:05 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info Aug 05 15:42:05 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:06 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info" returned: 0 in 0.388s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:06 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:42:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:06 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info Aug 05 15:42:06 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:06 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.info" returned: 0 in 0.583s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.776s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-be9edb32-006a-4a99-b89c-7b8e1e9ed0d6 req-cba922a6-fb11-45f7-a642-c8320272feba tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-be9edb32-006a-4a99-b89c-7b8e1e9ed0d6 req-cba922a6-fb11-45f7-a642-c8320272feba tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-be9edb32-006a-4a99-b89c-7b8e1e9ed0d6 req-cba922a6-fb11-45f7-a642-c8320272feba tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-79cf48b3-e20a-429d-9007-646167334efd tempest-GroupSnapshotsTest-2040095227 None] group_snapshot e1a72e8c-997c-4c2e-8d8f-56a269ee362b: created successfully Aug 05 15:42:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-be9edb32-006a-4a99-b89c-7b8e1e9ed0d6 req-cba922a6-fb11-45f7-a642-c8320272feba tempest-TestInstancesWithCinderVolumes-1806207960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb1fb4e7-4140-46b1-89aa-a234fb2a5f7b', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:42:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-be9edb32-006a-4a99-b89c-7b8e1e9ed0d6 req-cba922a6-fb11-45f7-a642-c8320272feba tempest-TestInstancesWithCinderVolumes-1806207960 None] attachment_update completed successfully. Aug 05 15:42:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] group_snapshot e1a72e8c-997c-4c2e-8d8f-56a269ee362b: deleting Aug 05 15:42:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] group_snapshot e1a72e8c-997c-4c2e-8d8f-56a269ee362b: deleting {{(pid=88999) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:42:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-b89128c2-f901-4454-b49e-d31f2a314960" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-b89128c2-f901-4454-b49e-d31f2a314960" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-b7f1baea-3977-4c83-ab0d-a0db63f13dae" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-b7f1baea-3977-4c83-ab0d-a0db63f13dae" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Deleting offline snapshot b7f1baea-3977-4c83-ab0d-a0db63f13dae of volume b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] snapshot_file for this snap is: volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e92b79e-879b-40bb-a864-915e600460c1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:08 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae Aug 05 15:42:08 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9bda8871-c545-49bd-80fa-7c9e36f394ad tempest-VolumesActionsTest-114127195 None] Acquiring lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" by "attach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9bda8871-c545-49bd-80fa-7c9e36f394ad tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" acquired by "attach_volume" :: waited 0.058s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:08 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae" returned: 0 in 0.700s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b89128c2-f901-4454-b49e-d31f2a314960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab77df2-cdb2-4fce-bacf-ee8f18cd70c3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:08 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9bda8871-c545-49bd-80fa-7c9e36f394ad tempest-VolumesActionsTest-114127195 None] Attaching volume 0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 to instance 761dc632-71e6-41f2-b6b5-53ef3ee12404 at mountpoint /dev/vdb on host None. Aug 05 15:42:08 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9bda8871-c545-49bd-80fa-7c9e36f394ad tempest-VolumesActionsTest-114127195 None] Attach volume completed successfully. Aug 05 15:42:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9bda8871-c545-49bd-80fa-7c9e36f394ad tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" released by "attach_volume" :: held 0.271s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:09 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 Aug 05 15:42:09 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1c2a9f-dc58-41ed-9d9e-c33292c35281 tempest-VolumesActionsTest-114127195 None] Acquiring lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-detach_volume" by "detach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1c2a9f-dc58-41ed-9d9e-c33292c35281 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:09 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8b1c2a9f-dc58-41ed-9d9e-c33292c35281 tempest-VolumesActionsTest-114127195 None] Detaching volume 0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 from instance 761dc632-71e6-41f2-b6b5-53ef3ee12404. Aug 05 15:42:09 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8b1c2a9f-dc58-41ed-9d9e-c33292c35281 tempest-VolumesActionsTest-114127195 None] Detach volume completed successfully. Aug 05 15:42:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1c2a9f-dc58-41ed-9d9e-c33292c35281 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-detach_volume" released by "detach_volume" :: held 0.100s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:09 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960" returned: 0 in 0.789s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:09 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae Aug 05 15:42:09 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:10 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:42:10 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:10 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae" returned: 0 in 0.698s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:10 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae Aug 05 15:42:10 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:10 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.485s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:42:10 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-66cdcb6a-35f6-4550-b8a4-dcfadb122e1b req-91702d45-2ba8-424f-ac99-4066dceba8f9 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-66cdcb6a-35f6-4550-b8a4-dcfadb122e1b req-91702d45-2ba8-424f-ac99-4066dceba8f9 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960.b7f1baea-3977-4c83-ab0d-a0db63f13dae" returned: 0 in 0.428s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-66cdcb6a-35f6-4550-b8a4-dcfadb122e1b req-91702d45-2ba8-424f-ac99-4066dceba8f9 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-b7f1baea-3977-4c83-ab0d-a0db63f13dae" released by "_delete_snapshot" :: held 2.776s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-b89128c2-f901-4454-b49e-d31f2a314960" released by "delete_snapshot" :: held 2.829s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-66cdcb6a-35f6-4550-b8a4-dcfadb122e1b req-91702d45-2ba8-424f-ac99-4066dceba8f9 tempest-TestInstancesWithCinderVolumes-1806207960 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-d64da106-0e43-4ad9-9a93-4790b975d087', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bc899a7-e3d5-42e8-b848-38ca02ff3dec', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:42:11 devstack cinder-volume[88999]: WARNING cinder.quota [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1674071325 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1674071325, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:11 devstack cinder-volume[88999]: WARNING cinder.quota [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1674071325 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1674071325, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-66cdcb6a-35f6-4550-b8a4-dcfadb122e1b req-91702d45-2ba8-424f-ac99-4066dceba8f9 tempest-TestInstancesWithCinderVolumes-1806207960 None] attachment_update completed successfully. Aug 05 15:42:11 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['a5a48f8f-2dbd-4132-90ee-cdbac0a70c63', 'e252903a-5aa4-4f8b-8a87-415e859b001e', 'e24faace-42f7-4228-b878-7ce272324335', 'dc73ad0d-aa53-485a-8139-3639f1a0afc3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-59904561-8fcc-491c-b449-5f65ebf2c86d tempest-GroupSnapshotsTest-2040095227 None] group_snapshot e1a72e8c-997c-4c2e-8d8f-56a269ee362b: deleted successfully Aug 05 15:42:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "cinder-quobyte-b89128c2-f901-4454-b49e-d31f2a314960" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-b89128c2-f901-4454-b49e-d31f2a314960" acquired by "delete_volume" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2ff99a-9a8f-488c-8817-7169c54eea2b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:12 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 Aug 05 15:42:12 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:12 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960" returned: 0 in 0.508s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:12 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960 Aug 05 15:42:12 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:13 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b89128c2-f901-4454-b49e-d31f2a314960" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Lock "cinder-quobyte-b89128c2-f901-4454-b49e-d31f2a314960" released by "delete_volume" :: held 0.927s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['6d1640ec-3092-4b66-b1f7-85cb49956b8b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:13 devstack cinder-volume[88999]: WARNING cinder.quota [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1674071325 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1674071325, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Created reservations ['60c8e6a8-760e-4e50-8ea9-87b165f6b669', '7d9dc35b-8044-4558-959b-cb159f741025', '667c5df2-744c-46b4-af08-7a52149b88b5', 'a27d6b51-e848-484e-893f-3addefa0550d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:13 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:42:13 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:13 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.408s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:13 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:42:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8f129b74-be7d-4447-9810-30e6ee0569b2 tempest-GroupSnapshotsTest-2040095227 None] Delete group completed successfully. Aug 05 15:42:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-624b29a7-97f7-4a9f-8082-f836199a36a7 req-32a456e6-30d8-4a2b-8151-f7ae55bcde29 tempest-TestInstancesWithCinderVolumes-1806207960 None] Terminate volume connection completed successfully. Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-624b29a7-97f7-4a9f-8082-f836199a36a7 req-32a456e6-30d8-4a2b-8151-f7ae55bcde29 tempest-TestInstancesWithCinderVolumes-1806207960 None] Deleting attachment eb1fb4e7-4140-46b1-89aa-a234fb2a5f7b. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "cinder-043a2c61-ba7a-4f36-b68d-c9205e3934b1-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-043a2c61-ba7a-4f36-b68d-c9205e3934b1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "cinder-quobyte-043a2c61-ba7a-4f36-b68d-c9205e3934b1" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-quobyte-043a2c61-ba7a-4f36-b68d-c9205e3934b1" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f754cc5a-98da-4f50-9f52-b267a7925589]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:18 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 Aug 05 15:42:18 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:18 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1" returned: 0 in 0.430s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:18 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1 Aug 05 15:42:18 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:18 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-043a2c61-ba7a-4f36-b68d-c9205e3934b1" returned: 0 in 0.304s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-quobyte-043a2c61-ba7a-4f36-b68d-c9205e3934b1" released by "delete_volume" :: held 0.799s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:18 devstack cinder-volume[88999]: WARNING cinder.quota [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622340504-1553281050 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622340504-1553281050, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:18 devstack cinder-volume[88999]: WARNING cinder.quota [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622340504-1553281050 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1622340504-1553281050, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Created reservations ['55aed3f9-6656-4963-a9eb-b5e844706d49', '92a5b24a-4508-4a39-a8af-70cfba72bd75', '264017d0-f68a-4904-82ba-0b7c409f196d', '250c1791-df0d-46de-818e-68d81e86fa4f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:19 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:42:19 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:19 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.447s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:19 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:42:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Deleted volume successfully. Aug 05 15:42:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0b69dde1-8464-4e83-837a-0f7602411c7a tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-043a2c61-ba7a-4f36-b68d-c9205e3934b1-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cc775836-b915-4a4c-8ac7-9db97fdae9b3 tempest-GroupSnapshotsV319Test-708165374 None] Group tempest-GroupSnapshotsV319Test-Group-758801320: creating Aug 05 15:42:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cc775836-b915-4a4c-8ac7-9db97fdae9b3 tempest-GroupSnapshotsV319Test-708165374 None] Group tempest-GroupSnapshotsV319Test-Group-758801320: created successfully Aug 05 15:42:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cc775836-b915-4a4c-8ac7-9db97fdae9b3 tempest-GroupSnapshotsV319Test-708165374 None] Create group completed successfully. Aug 05 15:42:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-681a33d7-1b6d-4979-a78d-dd61172dce66 req-0f906a5d-ca0f-41c6-ab0e-6a8c1a81d97d tempest-TestInstancesWithCinderVolumes-1806207960 None] Terminate volume connection completed successfully. Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-681a33d7-1b6d-4979-a78d-dd61172dce66 req-0f906a5d-ca0f-41c6-ab0e-6a8c1a81d97d tempest-TestInstancesWithCinderVolumes-1806207960 None] Deleting attachment 2bc899a7-e3d5-42e8-b848-38ca02ff3dec. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "cinder-d64da106-0e43-4ad9-9a93-4790b975d087-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-d64da106-0e43-4ad9-9a93-4790b975d087-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "cinder-quobyte-d64da106-0e43-4ad9-9a93-4790b975d087" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-quobyte-d64da106-0e43-4ad9-9a93-4790b975d087" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a077602-ce47-4458-81fc-12d796a4dd9b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:24 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 Aug 05 15:42:24 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:24 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087" returned: 0 in 0.726s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:24 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087 Aug 05 15:42:24 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:25 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d64da106-0e43-4ad9-9a93-4790b975d087" returned: 0 in 0.611s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-quobyte-d64da106-0e43-4ad9-9a93-4790b975d087" released by "delete_volume" :: held 1.454s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Flow 'volume_create_manager' (d4891652-ee13-464d-85ff-e88807d80256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ca9063-5565-479b-ac0c-13d4f6ddb91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ca9063-5565-479b-ac0c-13d4f6ddb91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1518251451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bd8637-4462-4996-9a7b-438fda2cd2c7,host='devstack@QuobyteHD#QuobyteHD',id=f24b66d4-6bbe-49dd-9810-1cbaa244120b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6eeb2485ea4d3190062a366b5a461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:42:25Z,use_quota=True,user_id='5350c1b6243c484eab8796470504cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6897ec-539d-4823-8174-ced04ca04175),volume_type_id=ca6897ec-539d-4823-8174-ced04ca04175)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d05d66-49e2-40ea-8935-0faea7e110ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d05d66-49e2-40ea-8935-0faea7e110ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c611d1c-32ec-48bc-850f-37f3f62a0b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c611d1c-32ec-48bc-850f-37f3f62a0b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24b66d4-6bbe-49dd-9810-1cbaa244120b', 'volume_name': 'volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d84db69-5b1f-4d3c-91f6-3f1cb82b48ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d84db69-5b1f-4d3c-91f6-3f1cb82b48ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6587c3c-77fd-4182-90ea-ec4fdf19379b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:25 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Volume f24b66d4-6bbe-49dd-9810-1cbaa244120b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b', 'volume_size': 1} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28bd8637-4462-4996-9a7b-438fda2cd2c7,created_at=2026-08-05T13:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1518251451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28bd8637-4462-4996-9a7b-438fda2cd2c7,host='devstack@QuobyteHD#QuobyteHD',id=f24b66d4-6bbe-49dd-9810-1cbaa244120b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6eeb2485ea4d3190062a366b5a461b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:42:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:42:25Z,use_quota=True,user_id='5350c1b6243c484eab8796470504cad0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca6897ec-539d-4823-8174-ced04ca04175),volume_type_id=ca6897ec-539d-4823-8174-ced04ca04175)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Creating volume f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:42:25 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:25 devstack cinder-volume[88999]: WARNING cinder.quota [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-957113084-1008358870 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-957113084-1008358870, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:25 devstack cinder-volume[88999]: WARNING cinder.quota [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-957113084-1008358870 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-957113084-1008358870, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:25 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b 1073741824 Aug 05 15:42:25 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Created reservations ['ec16e593-a6cf-47fb-9c2e-e9dc53c7c1cb', 'be01d060-9ac3-42d6-bfb9-27ffd9020a98', '493c69db-6b17-4c73-bb7b-eff87a3351db', 'e19df41b-b7f1-4f4a-b720-ce8a88e1209c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:25 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:42:25 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:26 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.446s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:42:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Deleted volume successfully. Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4fd414e4-be0e-40a6-b7cc-bbeb56d03dcf tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-d64da106-0e43-4ad9-9a93-4790b975d087-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:26 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b 1073741824" returned: 0 in 0.944s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:26 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b Aug 05 15:42:26 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:26 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b" returned: 0 in 0.456s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6587c3c-77fd-4182-90ea-ec4fdf19379b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718ea4b3-1b54-4d88-9b4b-85111dc486be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Volume volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b (f24b66d4-6bbe-49dd-9810-1cbaa244120b): created successfully Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (718ea4b3-1b54-4d88-9b4b-85111dc486be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Flow 'volume_create_manager' (d4891652-ee13-464d-85ff-e88807d80256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:42:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-19c7a12c-020c-4bba-a454-09037ea4b528 tempest-GroupSnapshotsV319Test-708165374 None] Created volume successfully. Aug 05 15:42:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] GroupSnapshot e17c7057-680b-43fd-8b5d-7d6530becf98: creating. Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Group snapshot e17c7057-680b-43fd-8b5d-7d6530becf98: creating. {{(pid=88999) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Creating offline snapshot 6a02a07d-1a13-4328-a852-66162a67cee6 of volume f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0af5a9b-3eec-429e-9b56-48534a8aa9f4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1135705-5c36-4d9f-b536-6d219c9cfdd8 tempest-VolumesActionsTest-114127195 None] Acquiring lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" by "attach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1135705-5c36-4d9f-b536-6d219c9cfdd8 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" acquired by "attach_volume" :: waited 0.079s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:29 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b Aug 05 15:42:29 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e1135705-5c36-4d9f-b536-6d219c9cfdd8 tempest-VolumesActionsTest-114127195 None] Attaching volume 0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 to instance 854d302c-b54f-4fa5-bc6b-e9ba9279dcb6 at mountpoint /dev/vdb on host None. Aug 05 15:42:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e1135705-5c36-4d9f-b536-6d219c9cfdd8 tempest-VolumesActionsTest-114127195 None] Attach volume completed successfully. Aug 05 15:42:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e1135705-5c36-4d9f-b536-6d219c9cfdd8 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" released by "attach_volume" :: held 0.377s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:29 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b" returned: 0 in 0.775s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:29 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 1G Aug 05 15:42:29 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-47d5980c-40ae-4f87-b140-d3efb935c991 tempest-VolumesActionsTest-114127195 None] Acquiring lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-detach_volume" by "detach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-47d5980c-40ae-4f87-b140-d3efb935c991 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-47d5980c-40ae-4f87-b140-d3efb935c991 tempest-VolumesActionsTest-114127195 None] Detaching volume 0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 from instance 854d302c-b54f-4fa5-bc6b-e9ba9279dcb6. Aug 05 15:42:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-47d5980c-40ae-4f87-b140-d3efb935c991 tempest-VolumesActionsTest-114127195 None] Detach volume completed successfully. Aug 05 15:42:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-47d5980c-40ae-4f87-b140-d3efb935c991 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-detach_volume" released by "detach_volume" :: held 0.225s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:30 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 1G" returned: 0 in 1.182s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:30 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 Aug 05 15:42:30 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:31 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6" returned: 0 in 0.603s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:31 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:42:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:31 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 Aug 05 15:42:31 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:31 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:31 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info Aug 05 15:42:31 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-70f616fb-490b-43ac-8ef5-4e1362185dd2 req-19af9ee6-ebe4-4462-8e28-f6f3dcb11634 tempest-TestInstancesWithCinderVolumes-1806207960 None] Terminate volume connection completed successfully. Aug 05 15:42:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-70f616fb-490b-43ac-8ef5-4e1362185dd2 req-19af9ee6-ebe4-4462-8e28-f6f3dcb11634 tempest-TestInstancesWithCinderVolumes-1806207960 None] Deleting attachment d63c992b-4d2a-4eab-b3e6-5d11cd9bf17d. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:42:32 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info" returned: 0 in 0.598s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:32 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:42:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:32 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info Aug 05 15:42:32 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:32 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.info" returned: 0 in 0.395s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-95f10ca3-b3ae-4ea6-8c7e-36356416f2f4 tempest-GroupSnapshotsV319Test-708165374 None] group_snapshot e17c7057-680b-43fd-8b5d-7d6530becf98: created successfully Aug 05 15:42:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] group_snapshot e17c7057-680b-43fd-8b5d-7d6530becf98: deleting Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] group_snapshot e17c7057-680b-43fd-8b5d-7d6530becf98: deleting {{(pid=88999) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "cinder-quobyte-f24b66d4-6bbe-49dd-9810-1cbaa244120b" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Lock "cinder-quobyte-f24b66d4-6bbe-49dd-9810-1cbaa244120b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "cinder-quobyte-6a02a07d-1a13-4328-a852-66162a67cee6" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Lock "cinder-quobyte-6a02a07d-1a13-4328-a852-66162a67cee6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Deleting offline snapshot 6a02a07d-1a13-4328-a852-66162a67cee6 of volume f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] snapshot_file for this snap is: volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ed0022-31cf-4674-b284-fc45c937d9de]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:34 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 Aug 05 15:42:34 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:34 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6" returned: 0 in 0.416s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9aaaa6-3307-44c5-b186-b44b2c8a4a26]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:34 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b Aug 05 15:42:34 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "cinder-1859aa80-3f44-4546-b194-b343d1a9d3ea-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-1859aa80-3f44-4546-b194-b343d1a9d3ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "cinder-quobyte-1859aa80-3f44-4546-b194-b343d1a9d3ea" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-quobyte-1859aa80-3f44-4546-b194-b343d1a9d3ea" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[82be3550-f9b5-46dd-a9d6-8c0376633f4a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:34 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b" returned: 0 in 0.459s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:34 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 Aug 05 15:42:34 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:34 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea Aug 05 15:42:34 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:35 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea" returned: 0 in 0.592s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:35 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea Aug 05 15:42:35 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:35 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6" returned: 0 in 0.616s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:35 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6 Aug 05 15:42:35 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:35 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b.6a02a07d-1a13-4328-a852-66162a67cee6" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:35 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1859aa80-3f44-4546-b194-b343d1a9d3ea" returned: 0 in 0.491s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Lock "cinder-quobyte-6a02a07d-1a13-4328-a852-66162a67cee6" released by "_delete_snapshot" :: held 1.964s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-quobyte-1859aa80-3f44-4546-b194-b343d1a9d3ea" released by "delete_volume" :: held 1.133s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Lock "cinder-quobyte-f24b66d4-6bbe-49dd-9810-1cbaa244120b" released by "delete_snapshot" :: held 2.002s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:35 devstack cinder-volume[88999]: WARNING cinder.quota [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645108886-1629462619 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645108886-1629462619, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:35 devstack cinder-volume[88999]: WARNING cinder.quota [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645108886-1629462619 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645108886-1629462619, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:35 devstack cinder-volume[88999]: WARNING cinder.quota [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-792517631 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-792517631, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:35 devstack cinder-volume[88999]: WARNING cinder.quota [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-792517631 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-792517631, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Created reservations ['356bfe72-5078-4cf7-847b-2b89f196706f', '7e0907e7-d739-4598-b449-646d3910a5ab', 'fdfae77e-1315-4978-876e-7159c8c7e1c0', 'ad420533-dbef-41ba-b54c-5155787313c8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:35 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] Created reservations ['5619e545-d1fa-4376-8ccc-ea912c19846c', 'dd523bf8-e79d-4d27-8c5b-58adc2a4c5f6', '920391e0-b5bc-475a-ad4e-d8cd8a6b2bd2', '0aa9e5c8-da5d-40a7-b1da-ad8228454aa9'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:36 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:42:36 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-300eff10-cf53-43ea-9662-e3dca34ec00b tempest-GroupSnapshotsV319Test-708165374 None] group_snapshot e17c7057-680b-43fd-8b5d-7d6530becf98: deleted successfully Aug 05 15:42:36 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:42:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Deleted volume successfully. Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3c9551b5-b230-40ca-befe-fd3931c2aff6 tempest-TestInstancesWithCinderVolumes-1806207960 None] Lock "cinder-1859aa80-3f44-4546-b194-b343d1a9d3ea-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "cinder-quobyte-f24b66d4-6bbe-49dd-9810-1cbaa244120b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Lock "cinder-quobyte-f24b66d4-6bbe-49dd-9810-1cbaa244120b" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfa7ee7-7d6f-43e1-b782-def444494f0d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69a6bd9-7828-4433-9256-553f11c14e1e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:36 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b Aug 05 15:42:36 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:36 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:42:36 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:37 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b" returned: 0 in 0.490s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:37 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b Aug 05 15:42:37 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:37 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.472s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55a6d2c-08a4-4558-90eb-8eb6868cacf5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:37 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:42:37 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:37 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f24b66d4-6bbe-49dd-9810-1cbaa244120b" returned: 0 in 0.298s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Lock "cinder-quobyte-f24b66d4-6bbe-49dd-9810-1cbaa244120b" released by "delete_volume" :: held 0.866s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Created reservations ['e19508d2-c51b-4cd8-addd-ed652dfb5fa0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:37 devstack cinder-volume[88999]: WARNING cinder.quota [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-792517631 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-792517631, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Created reservations ['8de63957-b891-4123-9d49-c8e548cb68ff', 'a75f6822-0232-42c3-b3a4-9aea559273ab', 'ec6068b6-a343-4662-b631-7b498d13dace', '546d99b5-aabc-400b-ac92-10f18ec9af3e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:42:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:37 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.716s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:38 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:42:38 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0f5e942d-7ac4-410c-b7a1-fe913fa5918f1t_i1rpg.img {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:38 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0f5e942d-7ac4-410c-b7a1-fe913fa5918f1t_i1rpg.img Aug 05 15:42:38 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:38 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.618s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:38 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:42:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ba426a6c-3ff8-4708-8ab1-e2aa52897729 tempest-GroupSnapshotsV319Test-708165374 None] Delete group completed successfully. Aug 05 15:42:43 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0f5e942d-7ac4-410c-b7a1-fe913fa5918f1t_i1rpg.img" returned: 0 in 5.513s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[957341ff-a064-405d-b944-ce8e6354eed7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:42:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:42:43 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:42:43 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:42:44 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Aug 05 15:42:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.587s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:42:44 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0f5e942d-7ac4-410c-b7a1-fe913fa5918f1t_i1rpg.img {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:42:44 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Converted 1024.00 MB image at 185.67 MB/s Aug 05 15:42:44 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] 0f5e942d-7ac4-410c-b7a1-fe913fa5918f was raw, no need to convert to raw {{(pid=88999) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 15:42:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a69eab42-0790-4136-a357-f9ec6651241c tempest-GroupsTest-1348992846 None] Group tempest-Group1-1830948838: creating Aug 05 15:42:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a69eab42-0790-4136-a357-f9ec6651241c tempest-GroupsTest-1348992846 None] Group tempest-Group1-1830948838: created successfully Aug 05 15:42:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a69eab42-0790-4136-a357-f9ec6651241c tempest-GroupsTest-1348992846 None] Create group completed successfully. Aug 05 15:42:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ea7c8161-2a22-4658-8f8c-5c188c006dc9 tempest-GroupsTest-1348992846 None] Group tempest-Group2-383316284: creating Aug 05 15:42:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ea7c8161-2a22-4658-8f8c-5c188c006dc9 tempest-GroupsTest-1348992846 None] Group tempest-Group2-383316284: created successfully Aug 05 15:42:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ea7c8161-2a22-4658-8f8c-5c188c006dc9 tempest-GroupsTest-1348992846 None] Create group completed successfully. Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=127,cinder:INSERT=33,cinder:UPDATE=111,cinder:DELETE=3 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=119,cinder:INSERT=23,cinder:UPDATE=119,cinder:DELETE=3 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Flow 'volume_create_manager' (647b3b28-e2b5-4c32-a210-f5408fdbf408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda2222-bba6-41b3-aadc-1c1f3aa6240a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda2222-bba6-41b3-aadc-1c1f3aa6240a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720969016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f77563a5-8c5d-493c-899d-315d6d29c1c2,host='devstack@QuobyteHD#QuobyteHD',id=fa7b8535-1ed7-4f4c-ada8-30acccb39675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd4fdb73fdb4c35860abfbfa100232d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:42:56Z,use_quota=True,user_id='380737eafd2d4945b1789fce9da9b072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb4c0049-71db-47ac-bb20-72eb82995b95),volume_type_id=fb4c0049-71db-47ac-bb20-72eb82995b95)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962fae2e-8bb9-4e88-a313-b63a6fa8f984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962fae2e-8bb9-4e88-a313-b63a6fa8f984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a87eb6a-b3da-40c5-90d4-cde641a044ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a87eb6a-b3da-40c5-90d4-cde641a044ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa7b8535-1ed7-4f4c-ada8-30acccb39675', 'volume_name': 'volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a025fe-5925-4293-bc57-cb459c79d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a025fe-5925-4293-bc57-cb459c79d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713b5bd7-f313-47f5-9a28-f5ca64f671dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:42:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Volume fa7b8535-1ed7-4f4c-ada8-30acccb39675: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675', 'volume_size': 1} Aug 05 15:42:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (7c05cf70-05f5-4339-89a1-30386630eb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c3d827-9815-4195-a587-5af3c1094f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c3d827-9815-4195-a587-5af3c1094f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327483536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:00Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7876347-2efd-4bd6-89e4-a92e119ff9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7876347-2efd-4bd6-89e4-a92e119ff9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec6bc0d-d9fe-451a-9f55-c1dede64bad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fec6bc0d-d9fe-451a-9f55-c1dede64bad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf', 'volume_name': 'volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a12b31-3392-4d70-ac34-ed2a0c1f3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9a12b31-3392-4d70-ac34-ed2a0c1f3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afed99af-a387-4f12-9e88-5fc264b5b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:00 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Volume 9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf', 'volume_size': 1} Aug 05 15:43:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:43:10 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:10 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:10 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.524s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:43:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.403s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Uploaded volume to glance image-id: 0f5e942d-7ac4-410c-b7a1-fe913fa5918f. {{(pid=88999) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.407s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f77563a5-8c5d-493c-899d-315d6d29c1c2,created_at=2026-08-05T13:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720969016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f77563a5-8c5d-493c-899d-315d6d29c1c2,host='devstack@QuobyteHD#QuobyteHD',id=fa7b8535-1ed7-4f4c-ada8-30acccb39675,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd4fdb73fdb4c35860abfbfa100232d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:42:56Z,use_quota=True,user_id='380737eafd2d4945b1789fce9da9b072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb4c0049-71db-47ac-bb20-72eb82995b95),volume_type_id=fb4c0049-71db-47ac-bb20-72eb82995b95)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Creating volume fa7b8535-1ed7-4f4c-ada8-30acccb39675 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:13 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7d8163a7-da4b-4d7b-a687-c498d188d36a tempest-VolumesActionsTest-114127195 None] Copy volume to image completed successfully. Aug 05 15:43:13 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 1073741824 Aug 05 15:43:13 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:13 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 1073741824" returned: 0 in 0.643s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:13 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 Aug 05 15:43:13 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:14 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675" returned: 0 in 0.318s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.967s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-327483536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:00Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Creating volume 9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:14 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:14 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf 1073741824 Aug 05 15:43:14 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713b5bd7-f313-47f5-9a28-f5ca64f671dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5fe29b-a9ee-4788-a8c2-1fca4bb97542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Volume volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 (fa7b8535-1ed7-4f4c-ada8-30acccb39675): created successfully Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e5fe29b-a9ee-4788-a8c2-1fca4bb97542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Flow 'volume_create_manager' (647b3b28-e2b5-4c32-a210-f5408fdbf408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5d3a8838-38a0-44bb-ad40-31ac6b54d77e tempest-GroupsTest-1348992846 None] Created volume successfully. Aug 05 15:43:14 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf 1073741824" returned: 0 in 0.567s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:14 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf Aug 05 15:43:14 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:15 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" returned: 0 in 0.350s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afed99af-a387-4f12-9e88-5fc264b5b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5c379e-0430-4b0e-bcf4-3e0555c1a90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Acquiring lock "cinder-quobyte-fa7b8535-1ed7-4f4c-ada8-30acccb39675" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:15 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Volume volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf (9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf): created successfully Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5c379e-0430-4b0e-bcf4-3e0555c1a90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (7c05cf70-05f5-4339-89a1-30386630eb80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Lock "cinder-quobyte-fa7b8535-1ed7-4f4c-ada8-30acccb39675" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-680e66f2-e598-4b5b-8c04-49bf879990d8 tempest-VolumesActionsTest-1335517166 None] Created volume successfully. Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[242bf90c-24bb-49d8-8e72-0303ec53d79f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9dce3e14-be1b-4ea7-b2a8-80063459c913 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" by "attach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9dce3e14-be1b-4ea7-b2a8-80063459c913 tempest-VolumesActionsTest-1335517166 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" acquired by "attach_volume" :: waited 0.043s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:15 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 Aug 05 15:43:15 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ae1e0c-c794-4140-b90e-4ab9777b4968]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9dce3e14-be1b-4ea7-b2a8-80063459c913 tempest-VolumesActionsTest-1335517166 None] Attaching volume 9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf to instance ca8d4911-420b-41dc-9c91-8366fa0579bc at mountpoint /dev/vdb on host None. Aug 05 15:43:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9dce3e14-be1b-4ea7-b2a8-80063459c913 tempest-VolumesActionsTest-1335517166 None] Attach volume completed successfully. Aug 05 15:43:15 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:43:15 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9dce3e14-be1b-4ea7-b2a8-80063459c913 tempest-VolumesActionsTest-1335517166 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" released by "attach_volume" :: held 0.204s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:15 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675" returned: 0 in 0.529s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:15 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675 Aug 05 15:43:15 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:16 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.531s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c762db55-18c5-482a-a370-1638befe8ed1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:16 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:43:16 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:16 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fa7b8535-1ed7-4f4c-ada8-30acccb39675" returned: 0 in 0.447s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Lock "cinder-quobyte-fa7b8535-1ed7-4f4c-ada8-30acccb39675" released by "delete_volume" :: held 1.069s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Created reservations ['36d9fdba-2a53-44f9-9dca-5cd57fcd9f3b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:16 devstack cinder-volume[88999]: WARNING cinder.quota [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2078853360 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2078853360, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:43:16 devstack cinder-volume[88999]: WARNING cinder.quota [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2078853360 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2078853360, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:43:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-80a36b6c-6126-484a-b552-00079b78ea43 tempest-VolumesActionsTest-1831365019 None] Terminate volume connection completed successfully. Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Created reservations ['c56b9370-9078-40f4-b700-297d96fc7c90', '7e3a42ac-6f6b-4782-b151-20804244221f', '41dbc16f-ab48-4003-ad92-413b41f8f9dd', 'f5bec05d-033e-4bdf-a1ef-56603aa19ebf'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80a36b6c-6126-484a-b552-00079b78ea43 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-detach_volume" by "detach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80a36b6c-6126-484a-b552-00079b78ea43 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-80a36b6c-6126-484a-b552-00079b78ea43 tempest-VolumesActionsTest-1831365019 None] Detaching volume 9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf from instance ca8d4911-420b-41dc-9c91-8366fa0579bc. Aug 05 15:43:16 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.593s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:16 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:16 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-80a36b6c-6126-484a-b552-00079b78ea43 tempest-VolumesActionsTest-1831365019 None] Detach volume completed successfully. Aug 05 15:43:16 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:16 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80a36b6c-6126-484a-b552-00079b78ea43 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-detach_volume" released by "detach_volume" :: held 0.123s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42545c87-5459-4c9f-83af-43161fda6dbd tempest-VolumesActionsTest-1335517166 None] Acquiring lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-detach_volume" by "detach_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42545c87-5459-4c9f-83af-43161fda6dbd tempest-VolumesActionsTest-1335517166 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-42545c87-5459-4c9f-83af-43161fda6dbd tempest-VolumesActionsTest-1335517166 None] Volume detach called, but volume not attached. Aug 05 15:43:17 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42545c87-5459-4c9f-83af-43161fda6dbd tempest-VolumesActionsTest-1335517166 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.294s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-241a6293-e0be-4d2d-82ef-d33f2dbea939 tempest-GroupsTest-1348992846 None] Delete group completed successfully. Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "cinder-quobyte-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Lock "cinder-quobyte-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" acquired by "delete_volume" :: waited 0.058s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4793b1d7-8ae8-4809-b1db-6b7bebd3c765]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:18 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf Aug 05 15:43:18 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Created reservations ['a4eb26e9-3516-4d71-9ebc-2867c344bcab'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:18 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" returned: 0 in 0.945s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:18 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:18 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:18 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf Aug 05 15:43:18 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:19 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.656s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:19 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6c86f46d-f917-41b7-b4ed-faef77f7c302 tempest-GroupsTest-1348992846 None] Delete group completed successfully. Aug 05 15:43:19 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" returned: 0 in 1.062s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Lock "cinder-quobyte-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf" released by "delete_volume" :: held 2.226s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Created reservations ['6e06e32f-df6e-4820-9728-e2a2b2b9e427', 'f827a15b-c502-4fed-9747-7e3b932f7500', 'b075f17f-b631-49dc-a7bf-18a962ab40ba', '14d0f4b1-964f-498c-b4ff-a4e2f6be122d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:20 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:20 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:21 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.762s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:21 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Deleted volume successfully. Aug 05 15:43:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6698d56f-78a5-4587-a265-014decb87904 tempest-VolumesActionsTest-1335517166 None] Lock "cinder-9a95be61-7e73-4ad8-ac4e-7ebf3b9e6adf-delete_volume" released by "delete_volume" :: held 3.887s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c35fd03c-b9e2-4852-9959-88478d27dba0 tempest-GroupsTest-1348992846 None] Group tempest-GroupsTest-Group-1421296181: creating Aug 05 15:43:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c35fd03c-b9e2-4852-9959-88478d27dba0 tempest-GroupsTest-1348992846 None] Group tempest-GroupsTest-Group-1421296181: created successfully Aug 05 15:43:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c35fd03c-b9e2-4852-9959-88478d27dba0 tempest-GroupsTest-1348992846 None] Create group completed successfully. Aug 05 15:43:23 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img" returned: 0 in 6.978s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[289dd70e-af6e-4a9d-99dd-137968b61ad1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:23 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:43:23 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Flow 'volume_create_manager' (84d5e137-4733-406e-bc8e-47c45e8ff1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e75844-561e-459c-930e-5cee5f1ad958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e75844-561e-459c-930e-5cee5f1ad958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978758973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec9641f-8851-449d-8c8b-263ff93a9d1f,host='devstack@QuobyteHD#QuobyteHD',id=0d8bb921-8426-40c7-b62b-4409e6b76502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd4fdb73fdb4c35860abfbfa100232d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:24Z,use_quota=True,user_id='380737eafd2d4945b1789fce9da9b072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6910bf8f-3dc4-4673-a49a-c0645a271660),volume_type_id=6910bf8f-3dc4-4673-a49a-c0645a271660)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f5d741-b45a-4af5-bece-51db09145761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36f5d741-b45a-4af5-bece-51db09145761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3d0ee9-82f2-4525-b4a0-deb226fe910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c3d0ee9-82f2-4525-b4a0-deb226fe910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8bb921-8426-40c7-b62b-4409e6b76502', 'volume_name': 'volume-0d8bb921-8426-40c7-b62b-4409e6b76502', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e1f0c9-c875-4d23-a328-d764f85bef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e1f0c9-c875-4d23-a328-d764f85bef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f1d1e7-ebae-440f-8b2f-1775f1be9516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:24 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Volume 0d8bb921-8426-40c7-b62b-4409e6b76502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8bb921-8426-40c7-b62b-4409e6b76502', 'volume_size': 1} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:24 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.777s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9, size 1024.00 MB, duration 6.98 sec, destination /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:43:24 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Converted 1024.00 MB image at 146.73 MB/s Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] 0438266a-6aa3-43e0-808d-27e233dcdd00 was raw, converting to qcow2 {{(pid=88999) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[11246de0-f031-4cec-9482-2ce795b42b0a]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:24 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img Aug 05 15:43:24 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:24 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img" returned: 0 in 0.413s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:25 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img Aug 05 15:43:25 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:25 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img" returned: 1 in 0.487s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:25 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj Aug 05 15:43:25 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:25 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj" returned: 0 in 0.307s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Image conversion details: src /opt/stack/data/cinder/conversion/0c65aef1-b202-4281-bcc6-97c8e2a6c2b9.temp_image.0438266a-6aa3-43e0-808d-27e233dcdd00jd_3ql0b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:43:25 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a655291f-d6fa-4735-8907-748e2846bc43]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:25 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj Aug 05 15:43:25 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:26 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6vkvlumj" returned: 0 in 0.416s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (7a7867ae-b1aa-4750-b06d-e47e12e8714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375e1e59-57f4-438d-ac3b-5d8b4b692138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (375e1e59-57f4-438d-ac3b-5d8b4b692138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2126300862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3601f89-c8b9-4335-b848-cc5850a416cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:27Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3527086e-0cd9-40c8-a84a-429074da633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3527086e-0cd9-40c8-a84a-429074da633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22461d9a-468f-427d-9f16-2bfd546a9ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22461d9a-468f-427d-9f16-2bfd546a9ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3601f89-c8b9-4335-b848-cc5850a416cf', 'volume_name': 'volume-e3601f89-c8b9-4335-b848-cc5850a416cf', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e435f4-dde2-4369-bd76-3677206c5fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4e435f4-dde2-4369-bd76-3677206c5fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df93222-290d-4ff8-9a80-1ac6c9d0a62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Volume e3601f89-c8b9-4335-b848-cc5850a416cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3601f89-c8b9-4335-b848-cc5850a416cf', 'volume_size': 1} Aug 05 15:43:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.396s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Uploaded volume to glance image-id: 0438266a-6aa3-43e0-808d-27e233dcdd00. {{(pid=88999) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.645s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cec9641f-8851-449d-8c8b-263ff93a9d1f,created_at=2026-08-05T13:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-978758973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec9641f-8851-449d-8c8b-263ff93a9d1f,host='devstack@QuobyteHD#QuobyteHD',id=0d8bb921-8426-40c7-b62b-4409e6b76502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd4fdb73fdb4c35860abfbfa100232d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:24Z,use_quota=True,user_id='380737eafd2d4945b1789fce9da9b072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6910bf8f-3dc4-4673-a49a-c0645a271660),volume_type_id=6910bf8f-3dc4-4673-a49a-c0645a271660)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Creating volume 0d8bb921-8426-40c7-b62b-4409e6b76502 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:27 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 1073741824 Aug 05 15:43:27 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ec10c18a-6f51-4020-807f-716068683e7f tempest-VolumesActionsTest-114127195 None] Copy volume to image completed successfully. Aug 05 15:43:28 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 1073741824" returned: 0 in 0.475s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:28 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 Aug 05 15:43:28 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:28 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502" returned: 0 in 0.262s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.837s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2126300862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3601f89-c8b9-4335-b848-cc5850a416cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:27Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Creating volume e3601f89-c8b9-4335-b848-cc5850a416cf {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:28 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:28 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf 1073741824 Aug 05 15:43:28 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92f1d1e7-ebae-440f-8b2f-1775f1be9516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8bb921-8426-40c7-b62b-4409e6b76502', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820f986f-6dac-4c5d-a7d9-149ec661df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Volume volume-0d8bb921-8426-40c7-b62b-4409e6b76502 (0d8bb921-8426-40c7-b62b-4409e6b76502): created successfully Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820f986f-6dac-4c5d-a7d9-149ec661df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Flow 'volume_create_manager' (84d5e137-4733-406e-bc8e-47c45e8ff1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f54697a4-a4d7-4380-93b7-4b9f091657c0 tempest-GroupsTest-1348992846 None] Created volume successfully. Aug 05 15:43:29 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf 1073741824" returned: 0 in 0.644s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:29 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf Aug 05 15:43:29 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Acquiring lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Acquiring lock "cinder-quobyte-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Lock "cinder-quobyte-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b06693-de16-41d4-8014-13a6e2f4bd0e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:29 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf" returned: 0 in 0.471s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df93222-290d-4ff8-9a80-1ac6c9d0a62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3601f89-c8b9-4335-b848-cc5850a416cf', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:29 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebe819d-e774-43a4-bf2f-6012cd7a3ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:29 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:29 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Volume volume-e3601f89-c8b9-4335-b848-cc5850a416cf (e3601f89-c8b9-4335-b848-cc5850a416cf): created successfully Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebe819d-e774-43a4-bf2f-6012cd7a3ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:29 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (7a7867ae-b1aa-4750-b06d-e47e12e8714c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-33c82157-7629-4038-b4d3-55e7fc2deae3 tempest-VolumesActionsTest-1335517166 None] Created volume successfully. Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Flow 'volume_create_manager' (bff84420-b04f-4466-8d7c-eb79aaf263fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103cd5de-ecf8-47da-b7d3-8ca18e168b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103cd5de-ecf8-47da-b7d3-8ca18e168b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892919981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec9641f-8851-449d-8c8b-263ff93a9d1f,host='devstack@QuobyteHD#QuobyteHD',id=166ac145-28bf-4f11-821c-646a33fcf623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd4fdb73fdb4c35860abfbfa100232d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:30Z,use_quota=True,user_id='380737eafd2d4945b1789fce9da9b072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6910bf8f-3dc4-4673-a49a-c0645a271660),volume_type_id=6910bf8f-3dc4-4673-a49a-c0645a271660)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85df252a-2b01-41c9-962d-58144bfa5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85df252a-2b01-41c9-962d-58144bfa5645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b8de9b-6f8f-45d6-a2a1-177add94fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b8de9b-6f8f-45d6-a2a1-177add94fde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '166ac145-28bf-4f11-821c-646a33fcf623', 'volume_name': 'volume-166ac145-28bf-4f11-821c-646a33fcf623', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2679606b-6c15-4e28-9153-bc49c3173fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2679606b-6c15-4e28-9153-bc49c3173fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdba465-0670-47ce-bbb8-f3d60d32b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:30 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Volume 166ac145-28bf-4f11-821c-646a33fcf623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-166ac145-28bf-4f11-821c-646a33fcf623', 'volume_size': 1} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cec9641f-8851-449d-8c8b-263ff93a9d1f,created_at=2026-08-05T13:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892919981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cec9641f-8851-449d-8c8b-263ff93a9d1f,host='devstack@QuobyteHD#QuobyteHD',id=166ac145-28bf-4f11-821c-646a33fcf623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cd4fdb73fdb4c35860abfbfa100232d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:30Z,use_quota=True,user_id='380737eafd2d4945b1789fce9da9b072',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6910bf8f-3dc4-4673-a49a-c0645a271660),volume_type_id=6910bf8f-3dc4-4673-a49a-c0645a271660)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Creating volume 166ac145-28bf-4f11-821c-646a33fcf623 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:30 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:30 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 1073741824 Aug 05 15:43:30 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:30 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.567s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:30 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9 Aug 05 15:43:30 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:30 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" returned: 0 in 0.336s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Lock "cinder-quobyte-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9" released by "delete_volume" :: held 0.976s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Created reservations ['8658a7a5-25c6-4620-9d43-ee8ef82b813e', '7741202e-9d51-406e-9429-9ab38a156f28', '841f2638-b46a-4252-8a29-1fc274743f18', 'ca14cf89-2070-40f5-8d54-af6639858c72'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:30 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 1073741824" returned: 0 in 0.568s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:30 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:30 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:30 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 Aug 05 15:43:30 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:31 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:31 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Deleted volume successfully. Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdba465-0670-47ce-bbb8-f3d60d32b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-166ac145-28bf-4f11-821c-646a33fcf623', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bb0758-40fe-4ec5-a543-e18a86851526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79be0d90-c6d3-4c52-8881-972ae290ec73 tempest-VolumesActionsTest-114127195 None] Lock "cinder-0c65aef1-b202-4281-bcc6-97c8e2a6c2b9-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Volume volume-166ac145-28bf-4f11-821c-646a33fcf623 (166ac145-28bf-4f11-821c-646a33fcf623): created successfully Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bb0758-40fe-4ec5-a543-e18a86851526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Flow 'volume_create_manager' (bff84420-b04f-4466-8d7c-eb79aaf263fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e45fe447-608d-4a79-84e5-9b7293ad665a tempest-GroupsTest-1348992846 None] Created volume successfully. Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-e3601f89-c8b9-4335-b848-cc5850a416cf-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-e3601f89-c8b9-4335-b848-cc5850a416cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-quobyte-e3601f89-c8b9-4335-b848-cc5850a416cf" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-e3601f89-c8b9-4335-b848-cc5850a416cf" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[981834e9-85b2-4b49-8cf5-4d072e3d10b1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:31 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf Aug 05 15:43:31 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:31 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf" returned: 0 in 0.422s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:31 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf Aug 05 15:43:31 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:32 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3601f89-c8b9-4335-b848-cc5850a416cf" returned: 0 in 0.294s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-e3601f89-c8b9-4335-b848-cc5850a416cf" released by "delete_volume" :: held 0.771s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Created reservations ['3fd66b45-65c5-4b9d-b2a4-81dadf00f285', 'add56085-a834-479f-9c1f-f259f3bf60aa', '60bff5a4-6231-4b69-bcd5-27b1f400d265', '9814751a-8cc7-4448-83c4-58c5c637ae87'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:32 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:32 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-285c8a7a-0aa4-4ec0-aa66-f02e263274a1 tempest-GroupsTest-1348992846 None] Update group completed successfully. Aug 05 15:43:32 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.563s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Deleted volume successfully. Aug 05 15:43:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a3b4a179-1da6-4853-9773-5f3d2676da52 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-e3601f89-c8b9-4335-b848-cc5850a416cf-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (dc83f4a2-f298-4c4a-8c6f-5a39de3f61f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482477cf-966d-4419-b2a1-a035eadf9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (482477cf-966d-4419-b2a1-a035eadf9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406966990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbd2846-a940-43eb-ba37-81e4bbd9a660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:33Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce05734-2172-48a9-bd31-a8ff2cd650d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce05734-2172-48a9-bd31-a8ff2cd650d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388d0ae8-85c5-4206-a039-eaf0bc8430da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388d0ae8-85c5-4206-a039-eaf0bc8430da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbd2846-a940-43eb-ba37-81e4bbd9a660', 'volume_name': 'volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8e72bb-4e45-466d-a2b6-4430efdbe60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb8e72bb-4e45-466d-a2b6-4430efdbe60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4532a637-361c-4408-b4ec-a4db78cf3c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Volume 2fbd2846-a940-43eb-ba37-81e4bbd9a660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660', 'volume_size': 1} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-406966990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbd2846-a940-43eb-ba37-81e4bbd9a660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:33Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Creating volume 2fbd2846-a940-43eb-ba37-81e4bbd9a660 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:33 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:33 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 1073741824 Aug 05 15:43:33 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:33 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 1073741824" returned: 0 in 0.606s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:34 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 Aug 05 15:43:34 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-957ba134-e1d8-4227-8f92-081fda9fbc57 tempest-GroupsTest-1348992846 None] Update group completed successfully. Aug 05 15:43:34 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660" returned: 0 in 0.325s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4532a637-361c-4408-b4ec-a4db78cf3c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1e8ae1-decb-40ad-b110-782b52277450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Volume volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 (2fbd2846-a940-43eb-ba37-81e4bbd9a660): created successfully Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d1e8ae1-decb-40ad-b110-782b52277450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (dc83f4a2-f298-4c4a-8c6f-5a39de3f61f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0a10afde-b4b6-40c7-a28a-baa5dc9a972d tempest-VolumesActionsTest-1335517166 None] Created volume successfully. Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Flow 'volume_create_manager' (85e95d07-6e67-47e3-a289-cad7783be82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a530998b-a3e8-4446-b78c-288e122057b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a530998b-a3e8-4446-b78c-288e122057b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1829686148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5af7bf-4213-4375-9daa-f69b3fd99c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fadb3719b7b4687b86ee341c5cf6848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:35Z,use_quota=True,user_id='6184ec3b1dfa4062bb697fc431556e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac08b47-5549-4206-be2f-a56cccd22c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac08b47-5549-4206-be2f-a56cccd22c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37a5ddb-4702-45c8-bb59-a12ebecad5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-2fbd2846-a940-43eb-ba37-81e4bbd9a660-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37a5ddb-4702-45c8-bb59-a12ebecad5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da5af7bf-4213-4375-9daa-f69b3fd99c3e', 'volume_name': 'volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce1d222-f50f-47f7-82bf-ef0655a4ac91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce1d222-f50f-47f7-82bf-ef0655a4ac91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1fe6aa-34ff-46c0-ab17-afdb5272f88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Volume da5af7bf-4213-4375-9daa-f69b3fd99c3e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Trying to clone da5af7bf-4213-4375-9daa-f69b3fd99c3e from image 84e9902b-fdcb-400c-bb6e-673761bd149d at location (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-2fbd2846-a940-43eb-ba37-81e4bbd9a660-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-quobyte-2fbd2846-a940-43eb-ba37-81e4bbd9a660" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-2fbd2846-a940-43eb-ba37-81e4bbd9a660" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3785dc63-acf5-404d-8581-372073ba7130]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Acquiring lock "cinder-quobyte-0d8bb921-8426-40c7-b62b-4409e6b76502" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:35 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 Aug 05 15:43:35 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:43:35 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Lock "cinder-quobyte-0d8bb921-8426-40c7-b62b-4409e6b76502" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35bf141-07bd-4650-9d84-e34bdf0c588e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a8eb63-9e2d-4292-bf3a-f3e6957905ed]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:36 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD Aug 05 15:43:36 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:36 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 Aug 05 15:43:36 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:36 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660" returned: 0 in 0.710s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:36 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660 Aug 05 15:43:36 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:36 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d is fetched for user 6184ec3b1dfa4062bb697fc431556e1a. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f495c62-029a-4d49-96f1-002c1d152621]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:36 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502" returned: 0 in 0.721s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:36 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2fbd2846-a940-43eb-ba37-81e4bbd9a660" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:36 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502 Aug 05 15:43:36 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-2fbd2846-a940-43eb-ba37-81e4bbd9a660" released by "delete_volume" :: held 1.146s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Created reservations ['59ae03db-8aec-4fbb-9128-0c00d8039acd', '3e03c481-8e42-4ccd-99f2-e1140f6bc0eb', 'b294e51f-e2fc-47f0-9a5b-42ca7f47ede5', 'e3869959-15c6-495c-b78f-4bf0d096cbee'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:36 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD Aug 05 15:43:36 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:36 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:36 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:36 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d8bb921-8426-40c7-b62b-4409e6b76502" returned: 0 in 0.292s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Lock "cinder-quobyte-0d8bb921-8426-40c7-b62b-4409e6b76502" released by "delete_volume" :: held 1.095s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Acquiring lock "cinder-quobyte-166ac145-28bf-4f11-821c-646a33fcf623" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Lock "cinder-quobyte-166ac145-28bf-4f11-821c-646a33fcf623" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddfe221-685e-4836-a8f2-ad3cfac3bf10]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:37 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD" returned: 0 in 0.563s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1829686148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5af7bf-4213-4375-9daa-f69b3fd99c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fadb3719b7b4687b86ee341c5cf6848',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:35Z,use_quota=True,user_id='6184ec3b1dfa4062bb697fc431556e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Creating volume da5af7bf-4213-4375-9daa-f69b3fd99c3e {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:37 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:37 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:37 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 Aug 05 15:43:37 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Deleted volume successfully. Aug 05 15:43:37 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e 1073741824 Aug 05 15:43:37 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eae5af1a-776b-4acf-a4b4-b2e6fde79435 tempest-VolumesActionsTest-1831365019 None] Lock "cinder-2fbd2846-a940-43eb-ba37-81e4bbd9a660-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:37 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623" returned: 0 in 0.534s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:37 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623 Aug 05 15:43:37 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:37 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e 1073741824" returned: 0 in 0.562s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:37 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e Aug 05 15:43:37 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:37 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-166ac145-28bf-4f11-821c-646a33fcf623" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Lock "cinder-quobyte-166ac145-28bf-4f11-821c-646a33fcf623" released by "delete_volume" :: held 0.976s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:38 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Created reservations ['7a8b04db-aa28-4182-945c-4c34e04e7929'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Attempting download of 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume da5af7bf-4213-4375-9daa-f69b3fd99c3e. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:43:38 devstack cinder-volume[88999]: WARNING cinder.quota [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1826730466 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1826730466, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:43:38 devstack cinder-volume[88999]: WARNING cinder.quota [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1826730466 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1826730466, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Created reservations ['60e1fa7f-7a10-4262-8e39-2e44a6e2336b', 'd13cc80f-b1f2-464c-a25b-193f68ffba37', '400e20b8-90ab-4fbb-98e9-46d8017adf26', 'd1ede36a-a5ca-4610-93fb-82bcbe1f5683'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4503960d-bb13-44b2-a71b-1250c2d7072c]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:38 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55 Aug 05 15:43:38 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (4a9c4cca-934b-4b63-9d96-c00b4ee76285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ee7511-7d44-4972-9b70-b7bbe739dbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ee7511-7d44-4972-9b70-b7bbe739dbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-18332212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92094291-3728-4912-8589-36f57b032946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:38Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3975b14e-b0b5-4111-a7c4-24cfe0848a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3975b14e-b0b5-4111-a7c4-24cfe0848a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932df6a5-2d24-45ce-a576-8c80de3b728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932df6a5-2d24-45ce-a576-8c80de3b728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92094291-3728-4912-8589-36f57b032946', 'volume_name': 'volume-92094291-3728-4912-8589-36f57b032946', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d7884d-19d1-477b-8a6b-d703ebcdc73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d7884d-19d1-477b-8a6b-d703ebcdc73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da916b0-b9d9-498c-9e76-8a9631e97009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Volume 92094291-3728-4912-8589-36f57b032946: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92094291-3728-4912-8589-36f57b032946', 'volume_size': 1} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-18332212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92094291-3728-4912-8589-36f57b032946,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:38Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Creating volume 92094291-3728-4912-8589-36f57b032946 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:38 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Created reservations ['8c0de1f4-4c40-4695-99d1-979abb9abf4d', '35c8d52c-0c51-4017-a147-03d26b443594', '40f8732c-c689-4435-8ad4-8af2167e22c0', 'b30af850-60f8-4d09-8801-44a2302b9f71'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:38 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 1073741824 Aug 05 15:43:38 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:38 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55" returned: 0 in 0.433s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:38 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55 Aug 05 15:43:38 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:38 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:38 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:39 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55" returned: 1 in 0.412s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_v63x4d55' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[37621109-942a-4210-a043-a6c1dd49fd50]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:39 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-beb6a8ff-f827-4def-b9eb-0a39d9ab7b1c tempest-GroupsTest-1348992846 None] Delete group completed successfully. Aug 05 15:43:39 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 1073741824" returned: 0 in 0.591s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:39 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD Aug 05 15:43:39 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:39 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 Aug 05 15:43:39 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:39 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] 84e9902b-fdcb-400c-bb6e-673761bd149d was qcow2, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:39 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e Aug 05 15:43:39 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:39 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da916b0-b9d9-498c-9e76-8a9631e97009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92094291-3728-4912-8589-36f57b032946', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fae89fd-8c9b-49db-8243-1a3806800ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Volume volume-92094291-3728-4912-8589-36f57b032946 (92094291-3728-4912-8589-36f57b032946): created successfully Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fae89fd-8c9b-49db-8243-1a3806800ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (4a9c4cca-934b-4b63-9d96-c00b4ee76285) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5110bc8b-ccda-4521-8bb0-0681d6d351c7 tempest-VolumesActionsTest-1335517166 None] Created volume successfully. Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Flow 'volume_create_manager' (93e938e1-a764-48c4-abf4-db54de238cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43e6b1a-e41e-4624-9efd-345d6c5fdf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43e6b1a-e41e-4624-9efd-345d6c5fdf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-313717645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fb8063-cfe3-4950-9d74-28ce36a33d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf76bdcf16a4bcc820face5cd1c3db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:41Z,use_quota=True,user_id='3aa7906348cb4822ba71e0dd5cf9d36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0f0ed0-6858-4421-b37a-82a5475028f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c0f0ed0-6858-4421-b37a-82a5475028f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba59bec-15d7-472a-a7ed-1e23ae7c7a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba59bec-15d7-472a-a7ed-1e23ae7c7a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14fb8063-cfe3-4950-9d74-28ce36a33d80', 'volume_name': 'volume-14fb8063-cfe3-4950-9d74-28ce36a33d80', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33a2f07-504f-43c5-a542-a1bfe594558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33a2f07-504f-43c5-a542-a1bfe594558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b866b94-73d8-4c1f-9ede-f61a56e73b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:40 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Volume 14fb8063-cfe3-4950-9d74-28ce36a33d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14fb8063-cfe3-4950-9d74-28ce36a33d80', 'volume_size': 1} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-313717645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14fb8063-cfe3-4950-9d74-28ce36a33d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf76bdcf16a4bcc820face5cd1c3db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:41Z,use_quota=True,user_id='3aa7906348cb4822ba71e0dd5cf9d36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Creating volume 14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:40 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-92094291-3728-4912-8589-36f57b032946-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:40 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 1073741824 Aug 05 15:43:40 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Lock "cinder-92094291-3728-4912-8589-36f57b032946-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-quobyte-92094291-3728-4912-8589-36f57b032946" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-92094291-3728-4912-8589-36f57b032946" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa574c-5bf7-4818-922d-1d3133d95fa5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:41 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 Aug 05 15:43:41 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:41 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 1073741824" returned: 0 in 0.639s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:41 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946" returned: 0 in 0.574s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:41 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 Aug 05 15:43:41 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:41 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946 Aug 05 15:43:41 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:41 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b866b94-73d8-4c1f-9ede-f61a56e73b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14fb8063-cfe3-4950-9d74-28ce36a33d80', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e521b38-4573-4b2c-ac4d-1d496f40c827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:41 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Volume volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 (14fb8063-cfe3-4950-9d74-28ce36a33d80): created successfully Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e521b38-4573-4b2c-ac4d-1d496f40c827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Flow 'volume_create_manager' (93e938e1-a764-48c4-abf4-db54de238cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-533722f6-04c3-40fc-b45f-3e4a277694ea tempest-VolumesCloneTest-1261031899 None] Created volume successfully. Aug 05 15:43:41 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:41 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e" returned: 0 in 2.402s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_v329z8vddevstack@QuobyteHD, size 112.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:43:41 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Converted 112.00 MB image at 46.61 MB/s Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-92094291-3728-4912-8589-36f57b032946" returned: 0 in 0.446s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:41 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e 1G Aug 05 15:43:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-92094291-3728-4912-8589-36f57b032946" released by "delete_volume" :: held 1.070s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:41 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Created reservations ['e3f68ccd-7ba4-49c6-9f1c-688cd4098a72', 'e82c83c0-7d39-4f20-a52c-2cf8cace57e8', '31efc151-5055-4427-9355-4d9a85746ddc', '2c113328-7668-40ce-b8d1-c28d7de8f912'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:42 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:42 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:42 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e 1G" returned: 0 in 0.395s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Downloaded image 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume da5af7bf-4213-4375-9daa-f69b3fd99c3e successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d for user 6184ec3b1dfa4062bb697fc431556e1a is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Marking volume da5af7bf-4213-4375-9daa-f69b3fd99c3e as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Copying metadata from image 84e9902b-fdcb-400c-bb6e-673761bd149d to da5af7bf-4213-4375-9daa-f69b3fd99c3e. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Creating volume glance metadata for volume da5af7bf-4213-4375-9daa-f69b3fd99c3e backed by image 84e9902b-fdcb-400c-bb6e-673761bd149d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:43:42 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.284s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Deleted volume successfully. Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e68c6f20-7bf9-4d5f-9860-b68f81be086e tempest-VolumesActionsTest-1831365019 None] Lock "cinder-92094291-3728-4912-8589-36f57b032946-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1fe6aa-34ff-46c0-ab17-afdb5272f88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33da57f7-1e96-4315-9354-902aa4135f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:42 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Volume volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e (da5af7bf-4213-4375-9daa-f69b3fd99c3e): created successfully Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33da57f7-1e96-4315-9354-902aa4135f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Flow 'volume_create_manager' (85e95d07-6e67-47e3-a289-cad7783be82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3d3fffc1-6e20-4ba9-af95-a3cce8beccfa tempest-TestShelveInstance-1859733100 None] Created volume successfully. Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Flow 'volume_create_manager' (979d2902-438f-48fd-9baa-6f80759968b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdf61dd-09b9-42bb-aa56-33036a3f798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdf61dd-09b9-42bb-aa56-33036a3f798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1908381178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf76bdcf16a4bcc820face5cd1c3db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=14fb8063-cfe3-4950-9d74-28ce36a33d80,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:43Z,use_quota=True,user_id='3aa7906348cb4822ba71e0dd5cf9d36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1565f5b-1484-48ee-9f91-07697c135e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1565f5b-1484-48ee-9f91-07697c135e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44a13ed-1fb8-42d0-ac45-4501cc47a260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44a13ed-1fb8-42d0-ac45-4501cc47a260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6', 'volume_name': 'volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6', 'volume_size': 2, 'source_volid': '14fb8063-cfe3-4950-9d74-28ce36a33d80', 'source_volstatus': 'available'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c2a508-acf2-4dff-a689-586d8d2f9525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c2a508-acf2-4dff-a689-586d8d2f9525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78623147-cc7f-47d6-94c4-720ec4b21ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Volume 2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6', 'volume_size': 2, 'source_volid': '14fb8063-cfe3-4950-9d74-28ce36a33d80', 'source_volstatus': 'available'} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:43 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Cloning volume 14fb8063-cfe3-4950-9d74-28ce36a33d80 to volume 2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Creating offline snapshot 30b3e5f4-856e-4271-beed-a59df244979d of volume 14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ee416-a08c-4dfc-8840-6865d379b243]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:43 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 Aug 05 15:43:43 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (f41c3a64-1612-4230-9624-59a048dc77e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9170bc8-05a6-45a5-9ba3-428e0c798998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9170bc8-05a6-45a5-9ba3-428e0c798998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857180427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:44Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b5ecf-6edd-43c1-9344-2bdaab100188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67b5ecf-6edd-43c1-9344-2bdaab100188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289f6976-5787-45f1-9310-f1fec9355917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289f6976-5787-45f1-9310-f1fec9355917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5', 'volume_name': 'volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48fa677-0778-420b-8b6a-da1a828c958c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d48fa677-0778-420b-8b6a-da1a828c958c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27db545-7a16-46ff-8d1e-837ed1df3f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:44 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Volume 55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5', 'volume_size': 1} Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:44 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80" returned: 0 in 0.537s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:44 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d 1G Aug 05 15:43:44 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:44 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d 1G" returned: 0 in 0.534s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:44 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d Aug 05 15:43:44 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:45 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:45 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d is being set with open permissions: ugo+rw Aug 05 15:43:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:45 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d Aug 05 15:43:45 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:45 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d" returned: 0 in 0.301s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:45 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info Aug 05 15:43:45 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:45 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info" returned: 0 in 0.319s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:45 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info is being set with open permissions: ugo+rw Aug 05 15:43:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:45 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info Aug 05 15:43:45 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b3e73e3a-8724-4309-abd6-d61e987e9755 tempest-GroupsV314Test-1589412303 None] Group tempest-GroupsV314Test-Group-1021008244: creating Aug 05 15:43:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b3e73e3a-8724-4309-abd6-d61e987e9755 tempest-GroupsV314Test-1589412303 None] Group tempest-GroupsV314Test-Group-1021008244: created successfully Aug 05 15:43:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b3e73e3a-8724-4309-abd6-d61e987e9755 tempest-GroupsV314Test-1589412303 None] Create group completed successfully. Aug 05 15:43:46 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.info" returned: 0 in 0.356s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "cinder-quobyte-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] snapshot: 30b3e5f4-856e-4271-beed-a59df244979d, volume: 2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1698a3-b640-4d4e-a205-26ce57f411dc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:46 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d Aug 05 15:43:46 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:46 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d" returned: 0 in 0.460s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14fb8063-cfe3-4950-9d74-28ce36a33d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c816152-2eb2-43e6-9f1d-29efcf2d1586]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1401dca4-58b9-482b-8625-1d07a452430b req-64400fae-410a-4393-ad69-828a0fce4e7d tempest-TestShelveInstance-1859733100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:46 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 Aug 05 15:43:46 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:47 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80" returned: 0 in 0.400s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:47 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 Aug 05 15:43:47 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Flow 'volume_create_manager' (09c9b69f-edee-4749-b179-26dfeda01e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7d5989-9cd4-4e74-a460-25574e9e168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7d5989-9cd4-4e74-a460-25574e9e168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874106884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4c743a9-8229-4034-929e-70ea78b8267f,host='devstack@QuobyteHD#QuobyteHD',id=314eec7d-9e4f-47e7-ba29-382ffae94ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baca9c05a3da495cbf70236638305bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:48Z,use_quota=True,user_id='0a523e218f77483e97751a237b9c787f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a419d1-662d-43a8-8e8c-f9e1a82fef56),volume_type_id=c5a419d1-662d-43a8-8e8c-f9e1a82fef56)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357b354d-325e-4348-b781-09238d87cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357b354d-325e-4348-b781-09238d87cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549a780a-f123-4247-a646-ee85c0f5980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549a780a-f123-4247-a646-ee85c0f5980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314eec7d-9e4f-47e7-ba29-382ffae94ce6', 'volume_name': 'volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c9c172-5b51-4a45-8b74-9e1ad3890794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c9c172-5b51-4a45-8b74-9e1ad3890794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6df5ec-1c1b-4e70-a0d1-1a3949dd8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Volume 314eec7d-9e4f-47e7-ba29-382ffae94ce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6', 'volume_size': 1} Aug 05 15:43:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:52 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" returned: 0 in 5.516s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:43:52 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Converted 1024.00 MB image at 185.63 MB/s Aug 05 15:43:52 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 is being set with open permissions: ugo+rw Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:52 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 Aug 05 15:43:52 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:52 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" returned: 0 in 0.242s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" released by "_copy_volume_from_snapshot" :: held 6.708s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "cinder-quobyte-30b3e5f4-856e-4271-beed-a59df244979d" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-30b3e5f4-856e-4271-beed-a59df244979d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Deleting offline snapshot 30b3e5f4-856e-4271-beed-a59df244979d of volume 14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] snapshot_file for this snap is: volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fd7cc-27eb-4311-b906-8d2d4be88be1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:52 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d Aug 05 15:43:52 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:53 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14fb8063-cfe3-4950-9d74-28ce36a33d80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:43:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf5c85d-fd0f-4df8-b07e-6e177a095c70]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:53 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 Aug 05 15:43:53 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:53 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80" returned: 0 in 0.558s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:53 devstack sudo[100670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d Aug 05 15:43:53 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:54 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d" returned: 0 in 0.353s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:54 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d Aug 05 15:43:54 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:54 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80.30b3e5f4-856e-4271-beed-a59df244979d" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-30b3e5f4-856e-4271-beed-a59df244979d" released by "_delete_snapshot" :: held 1.615s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.936s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.467s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857180427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:44Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Creating volume 55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:54 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78623147-cc7f-47d6-94c4-720ec4b21ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6', 'volume_size': 2, 'source_volid': '14fb8063-cfe3-4950-9d74-28ce36a33d80', 'source_volstatus': 'available'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:54 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 1073741824 Aug 05 15:43:54 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd54b83-6e2e-49d6-8f68-b9c9faea09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:54 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Volume volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 (2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6): created successfully Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dd54b83-6e2e-49d6-8f68-b9c9faea09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Flow 'volume_create_manager' (979d2902-438f-48fd-9baa-6f80759968b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6658c59c-e3d3-46b9-aa8d-fc0cf7af9ee7 tempest-VolumesCloneTest-1261031899 None] Created volume successfully. Aug 05 15:43:54 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 1073741824" returned: 0 in 0.423s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:54 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 Aug 05 15:43:54 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:55 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1401dca4-58b9-482b-8625-1d07a452430b req-64400fae-410a-4393-ad69-828a0fce4e7d tempest-TestShelveInstance-1859733100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.463s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27db545-7a16-46ff-8d1e-837ed1df3f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e5a112-fa49-4ba1-ba01-4dfa98f87466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-1401dca4-58b9-482b-8625-1d07a452430b req-64400fae-410a-4393-ad69-828a0fce4e7d tempest-TestShelveInstance-1859733100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.437s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c4c743a9-8229-4034-929e-70ea78b8267f,created_at=2026-08-05T13:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-874106884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c4c743a9-8229-4034-929e-70ea78b8267f,host='devstack@QuobyteHD#QuobyteHD',id=314eec7d-9e4f-47e7-ba29-382ffae94ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baca9c05a3da495cbf70236638305bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:48Z,use_quota=True,user_id='0a523e218f77483e97751a237b9c787f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a419d1-662d-43a8-8e8c-f9e1a82fef56),volume_type_id=c5a419d1-662d-43a8-8e8c-f9e1a82fef56)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Creating volume 314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:43:55 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:55 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Volume volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 (55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5): created successfully Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e5a112-fa49-4ba1-ba01-4dfa98f87466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:55 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 1073741824 Aug 05 15:43:55 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (f41c3a64-1612-4230-9624-59a048dc77e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a626f0cb-d33a-4de5-9232-689055bb044e tempest-VolumesActionsTest-1335517166 None] Created volume successfully. Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1401dca4-58b9-482b-8625-1d07a452430b req-64400fae-410a-4393-ad69-828a0fce4e7d tempest-TestShelveInstance-1859733100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daf3355e-b8c5-4b3d-9764-9ecbe55ac1da', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:43:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-1401dca4-58b9-482b-8625-1d07a452430b req-64400fae-410a-4393-ad69-828a0fce4e7d tempest-TestShelveInstance-1859733100 None] attachment_update completed successfully. Aug 05 15:43:55 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 1073741824" returned: 0 in 0.584s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:55 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 Aug 05 15:43:55 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Lock "cinder-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Acquiring lock "cinder-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Acquiring lock "cinder-quobyte-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Lock "cinder-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5" acquired by "delete_volume" :: waited 0.055s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[200a4d08-d22f-489a-8d58-3f7356f188f0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Acquiring lock "cinder-quobyte-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037b2d1-186f-49da-87e6-1bea5a2c1504]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:56 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6df5ec-1c1b-4e70-a0d1-1a3949dd8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34451493-1fde-4b7c-a98c-0c27461bccc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Volume volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 (314eec7d-9e4f-47e7-ba29-382ffae94ce6): created successfully Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34451493-1fde-4b7c-a98c-0c27461bccc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Flow 'volume_create_manager' (09c9b69f-edee-4749-b179-26dfeda01e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-358c07bf-f2bd-4e52-ba9e-32fdf70b3fd7 tempest-GroupsV314Test-1589412303 None] Created volume successfully. Aug 05 15:43:56 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 Aug 05 15:43:56 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:56 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 Aug 05 15:43:56 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:56 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5" returned: 0 in 0.720s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:56 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:56 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5 Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" returned: 0 in 0.693s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:56 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:56 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6 Aug 05 15:43:56 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:57 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" returned: 0 in 0.515s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:57 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5" returned: 0 in 0.583s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6" released by "delete_volume" :: held 1.274s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Lock "cinder-quobyte-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5" released by "delete_volume" :: held 1.372s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Created reservations ['72b0fcc0-7d10-42ac-a99a-64d9f6a5d096', 'b5be7d0e-2130-4b0a-92b9-29892b7097fd', '7b556899-ce9f-49ac-8c34-548b9a213dcf', '28c65c87-51a8-4220-8547-81023f74d57f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Created reservations ['0a03155a-312e-4f4b-8f12-521a1b68ed29', '7958563a-3368-418d-bdcc-7ac6525b3551', 'b99d9b18-bf80-416d-b3e0-eecfc5e15624', 'ae955522-82ac-4465-aa48-2f827cbad3cd'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:57 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:57 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:57 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:43:57 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:57 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Deleted volume successfully. Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:43:57 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Cloning volume 314eec7d-9e4f-47e7-ba29-382ffae94ce6 to volume 3120400d-5ece-4bc7-a707-3b662004039f Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ac4e2395-949c-4873-84f3-eea210f635fd tempest-VolumesCloneTest-1261031899 None] Lock "cinder-2ee11c00-6989-4f86-ad32-6f0a5ca3d3e6-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:57 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Creating offline snapshot e337d164-777b-4320-b10a-5850e11e8e4e of volume 314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.362s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:57 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:43:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Deleted volume successfully. Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0849fb0a-84ff-4841-a42b-24e937ff66ef]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a90746ea-ab4a-43f8-9c9a-3d9e0f608feb tempest-VolumesActionsTest-1831365019 None] Lock "cinder-55d76ad4-c8e3-4f54-b506-2c2f7f3d9ef5-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:58 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 Aug 05 15:43:58 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "cinder-14fb8063-cfe3-4950-9d74-28ce36a33d80-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-14fb8063-cfe3-4950-9d74-28ce36a33d80-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:58 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6" returned: 0 in 0.611s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:58 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e 1G Aug 05 15:43:58 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "cinder-quobyte-14fb8063-cfe3-4950-9d74-28ce36a33d80" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-14fb8063-cfe3-4950-9d74-28ce36a33d80" acquired by "delete_volume" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddca85b-4acb-4565-b4d8-70f9ef8c64b3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:43:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 Aug 05 15:43:59 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (daded1e3-c40b-4030-bed6-ecde7e43461e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0ec1ea-652b-4871-b7d0-cc8d655450f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0ec1ea-652b-4871-b7d0-cc8d655450f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1867103459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:59Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779a0188-59df-4039-9a0f-670df2d21e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779a0188-59df-4039-9a0f-670df2d21e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a0017-aac7-4c34-a58c-93f9305f53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a8a0017-aac7-4c34-a58c-93f9305f53dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df', 'volume_name': 'volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcff979-a724-40f4-a307-d93165f16cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bcff979-a724-40f4-a307-d93165f16cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a24ceb-aae9-4700-af06-9593ee443f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:43:59 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Volume f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df', 'volume_size': 1} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:43:59 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e 1G" returned: 0 in 0.576s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e Aug 05 15:43:59 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80" returned: 0 in 0.525s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80 Aug 05 15:43:59 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e" returned: 0 in 0.585s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:43:59 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14fb8063-cfe3-4950-9d74-28ce36a33d80" returned: 0 in 0.432s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:43:59 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e Aug 05 15:43:59 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-quobyte-14fb8063-cfe3-4950-9d74-28ce36a33d80" released by "delete_volume" :: held 1.086s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:43:59 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Created reservations ['5cd410b8-0bf9-4462-858b-093e5fa24c92', '8f9a9f38-f5e2-4aae-85b0-b7608c913bfd', 'a55253ec-4cc4-4147-b2e1-4f3808ea163f', '9e4ca2bd-e24f-4a2b-8169-3a1e2a38d12d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:00 devstack sudo[101208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:00 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:00 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e" returned: 0 in 0.347s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:00 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info Aug 05 15:44:00 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:00 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:00 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Deleted volume successfully. Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a08f0226-028e-4022-8f0c-f5483ad851d4 tempest-VolumesCloneTest-1261031899 None] Lock "cinder-14fb8063-cfe3-4950-9d74-28ce36a33d80-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:00 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:00 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:00 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info Aug 05 15:44:00 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:00 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.info" returned: 0 in 0.269s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Acquiring lock "cinder-quobyte-3120400d-5ece-4bc7-a707-3b662004039f" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-3120400d-5ece-4bc7-a707-3b662004039f" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] snapshot: e337d164-777b-4320-b10a-5850e11e8e4e, volume: 3120400d-5ece-4bc7-a707-3b662004039f, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b762c-d5fc-49eb-aac8-81f207da24d1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:00 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e Aug 05 15:44:00 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:01 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e" returned: 0 in 0.504s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d78c522-6f01-4de7-9434-db94ed0315e9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:01 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 Aug 05 15:44:01 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:01 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6" returned: 0 in 0.585s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:44:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:01 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f Aug 05 15:44:01 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:09 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f" returned: 0 in 7.612s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:09 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6, size 1024.00 MB, duration 7.61 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:44:09 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Converted 1024.00 MB image at 134.51 MB/s Aug 05 15:44:09 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f is being set with open permissions: ugo+rw: NotImplementedError Aug 05 15:44:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:09 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f Aug 05 15:44:09 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:09 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f" returned: 0 in 0.454s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-3120400d-5ece-4bc7-a707-3b662004039f" released by "_copy_volume_from_snapshot" :: held 9.266s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Acquiring lock "cinder-quobyte-e337d164-777b-4320-b10a-5850e11e8e4e" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-e337d164-777b-4320-b10a-5850e11e8e4e" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Deleting offline snapshot e337d164-777b-4320-b10a-5850e11e8e4e of volume 314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] snapshot_file for this snap is: volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eeb169-68ca-456a-b29f-6c0e70234d9c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:10 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:10 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:10 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e Aug 05 15:44:10 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=127,cinder:UPDATE=132,cinder:INSERT=39,cinder:DELETE=14 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:44:10 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.482s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:44:10 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e" returned: 0 in 0.702s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0e233d-3c08-4879-86d4-df7979d4694b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=131,cinder:UPDATE=159,cinder:INSERT=39,cinder:DELETE=6 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:44:10 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 Aug 05 15:44:10 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Flow 'volume_create_manager' (d28f3025-ee4b-4fd4-819e-d0497cb06898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b39789-9d4c-4d0a-bb5b-0e9df7cd15ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b39789-9d4c-4d0a-bb5b-0e9df7cd15ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-573580958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2deb4ef2-9b14-42cd-aabb-25fc480a303a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9eb7f9bc914d7b8b1d33c12d0591e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:11Z,use_quota=True,user_id='3966fb4711924d1eb9e8848ca795de2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e98a4c-9824-4b87-ade6-de1f319136a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e98a4c-9824-4b87-ade6-de1f319136a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7b5c98-db96-47c3-983c-a5c581d5278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7b5c98-db96-47c3-983c-a5c581d5278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2deb4ef2-9b14-42cd-aabb-25fc480a303a', 'volume_name': 'volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a231eb-b48e-4111-b9c7-8097b3ac181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a231eb-b48e-4111-b9c7-8097b3ac181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab973b2-6268-473d-b54b-8138380f3815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Volume 2deb4ef2-9b14-42cd-aabb-25fc480a303a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a', 'volume_size': 1} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:11 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6" returned: 0 in 0.598s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:11 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e Aug 05 15:44:11 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:11 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e" returned: 0 in 0.376s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:11 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e Aug 05 15:44:11 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:12 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6.e337d164-777b-4320-b10a-5850e11e8e4e" returned: 0 in 0.268s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-e337d164-777b-4320-b10a-5850e11e8e4e" released by "_delete_snapshot" :: held 2.050s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.218s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.991s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:43:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1867103459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6008ff9b4f8046a681abeaa6f68d5292',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:43:59Z,use_quota=True,user_id='eefc6bfacfe24c1294d03f0534f55015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Creating volume f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:12 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:12 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df 1073741824 Aug 05 15:44:12 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:12 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-16e8d06b-4f9c-4984-a0e3-3e97b5b6bc5c tempest-GroupsV314Test-1589412303 None] Create group from source-group-c4c743a9-8229-4034-929e-70ea78b8267f completed successfully. Aug 05 15:44:12 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df 1073741824" returned: 0 in 0.451s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:12 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df Aug 05 15:44:12 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:12 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.843s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-573580958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2deb4ef2-9b14-42cd-aabb-25fc480a303a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f9eb7f9bc914d7b8b1d33c12d0591e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:11Z,use_quota=True,user_id='3966fb4711924d1eb9e8848ca795de2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Creating volume 2deb4ef2-9b14-42cd-aabb-25fc480a303a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:12 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a24ceb-aae9-4700-af06-9593ee443f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:12 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a 1073741824 Aug 05 15:44:12 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bdc19e-e5a2-42d0-b7e4-a3d107f61fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:12 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Volume volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df (f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df): created successfully Aug 05 15:44:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bdc19e-e5a2-42d0-b7e4-a3d107f61fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Flow 'volume_create_manager' (daded1e3-c40b-4030-bed6-ecde7e43461e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5bfd3530-a1ee-4997-981a-b682990927b1 tempest-VolumesActionsTest-1335517166 None] Created volume successfully. Aug 05 15:44:13 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a 1073741824" returned: 0 in 0.416s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:13 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a Aug 05 15:44:13 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:13 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Acquiring lock "cinder-quobyte-3120400d-5ece-4bc7-a707-3b662004039f" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab973b2-6268-473d-b54b-8138380f3815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1922cd-8beb-4a2c-bf21-8af2e04ba814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-3120400d-5ece-4bc7-a707-3b662004039f" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Volume volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a (2deb4ef2-9b14-42cd-aabb-25fc480a303a): created successfully Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1922cd-8beb-4a2c-bf21-8af2e04ba814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Flow 'volume_create_manager' (d28f3025-ee4b-4fd4-819e-d0497cb06898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ce02b-9a3e-4478-96f9-343c44d2a450]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fdacc9f6-bf57-4448-9c27-c87223e05adb tempest-VolumesNegativeTest-1152611177 None] Created volume successfully. Aug 05 15:44:13 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f Aug 05 15:44:13 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:14 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f" returned: 0 in 0.474s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:14 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f Aug 05 15:44:14 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:14 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3120400d-5ece-4bc7-a707-3b662004039f" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-3120400d-5ece-4bc7-a707-3b662004039f" released by "delete_volume" :: held 0.886s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Created reservations ['4bbabe7b-c212-45eb-87ee-9bdf77fb4aa0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:14 devstack cinder-volume[88999]: WARNING cinder.quota [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-478326139 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-478326139, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:44:14 devstack cinder-volume[88999]: WARNING cinder.quota [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-478326139 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-478326139, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Created reservations ['cb48bd36-08e2-4b86-8262-36ea7545dd20', '2af5f176-0606-48d7-91fd-84ca845d8e74', '30c8cae3-00a1-430f-89b0-1f38fd41864b', '3413a177-65ae-4553-99f6-992a3db9b0e0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Acquiring lock "cinder-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Lock "cinder-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Acquiring lock "cinder-quobyte-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Lock "cinder-quobyte-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df" acquired by "delete_volume" :: waited 0.041s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f19043-eaf2-4c93-9384-3ea13a992cbb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:15 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:15 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:15 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df Aug 05 15:44:15 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:15 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-48055aa4-4029-45d4-96cc-216a03bf4996 tempest-GroupsV314Test-1589412303 None] Delete group completed successfully. Aug 05 15:44:15 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df" returned: 0 in 0.481s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:15 devstack sudo[101348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df Aug 05 15:44:15 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:15 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df" returned: 0 in 0.325s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Lock "cinder-quobyte-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df" released by "delete_volume" :: held 0.878s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Created reservations ['0e9badd9-7417-459f-9526-3c0a2a1790f8', '41d5d9a5-924d-49ee-a711-d3ea5d25ed3f', 'bafae024-d0fe-4ebf-976a-4151ca53b9d3', 'b3d6e2e3-e1ba-434c-baba-e04d4df957b8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:16 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:16 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:16 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Deleted volume successfully. Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-629702fb-3c7a-4de4-b7ca-51cff166251b tempest-VolumesActionsTest-1335517166 None] Lock "cinder-f8e50bbf-0ca8-4102-bb2f-eb62b01ea3df-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Acquiring lock "cinder-quobyte-314eec7d-9e4f-47e7-ba29-382ffae94ce6" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-314eec7d-9e4f-47e7-ba29-382ffae94ce6" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e07dcb8-2343-4f39-9f57-0bc2e8de68db]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:16 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 Aug 05 15:44:16 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:17 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6" returned: 0 in 0.585s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:17 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6 Aug 05 15:44:17 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:17 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-314eec7d-9e4f-47e7-ba29-382ffae94ce6" returned: 0 in 0.352s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Lock "cinder-quobyte-314eec7d-9e4f-47e7-ba29-382ffae94ce6" released by "delete_volume" :: held 1.045s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:17 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Created reservations ['fb799ce5-a51f-4371-bf89-2951efb84640'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:17 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Created reservations ['0f2ff93c-e797-4658-8029-e013b978df35', '136a50d1-29f0-4509-9181-50bb8ee2f78a', 'c7938cd1-075e-43a3-8c1d-2360a78d26c3', 'a338fd7d-25bb-47fd-a15a-f4f46a385b7d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:18 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:18 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:18 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.394s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:18 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f235697d-34be-4095-a650-1cc374e9c519 tempest-GroupsV314Test-1589412303 None] Delete group completed successfully. Aug 05 15:44:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-363aee11-a518-4491-8e4c-df11e66ffa78 tempest-GroupsV320Test-1573126044 None] Group tempest-GroupsV320Test-Group-1819646881: creating Aug 05 15:44:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-363aee11-a518-4491-8e4c-df11e66ffa78 tempest-GroupsV320Test-1573126044 None] Group tempest-GroupsV320Test-Group-1819646881: created successfully Aug 05 15:44:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-363aee11-a518-4491-8e4c-df11e66ffa78 tempest-GroupsV320Test-1573126044 None] Create group completed successfully. Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Created reservations ['e9b3818e-95e9-4662-8285-3cdfa88906d1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:27 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:27 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:28 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.386s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:28 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-67517e2b-e615-4f23-b94d-65b0472612df tempest-GroupsV320Test-1573126044 None] Delete group completed successfully. Aug 05 15:44:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-a4234c2f-a08b-4094-b59b-aa4faf364712 req-b72f0bbd-e4d8-4556-ba66-0c9540d24dea tempest-TestShelveInstance-1859733100 None] Terminate volume connection completed successfully. Aug 05 15:44:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-a4234c2f-a08b-4094-b59b-aa4faf364712 req-b72f0bbd-e4d8-4556-ba66-0c9540d24dea tempest-TestShelveInstance-1859733100 None] Deleting attachment daf3355e-b8c5-4b3d-9764-9ecbe55ac1da. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:44:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-2ebb96c9-011c-42d5-94a1-bf0b6b296259 req-a9ba4533-74c7-485c-b597-fff2f3725787 tempest-TestShelveInstance-1859733100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-2ebb96c9-011c-42d5-94a1-bf0b6b296259 req-a9ba4533-74c7-485c-b597-fff2f3725787 tempest-TestShelveInstance-1859733100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-2ebb96c9-011c-42d5-94a1-bf0b6b296259 req-a9ba4533-74c7-485c-b597-fff2f3725787 tempest-TestShelveInstance-1859733100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-2ebb96c9-011c-42d5-94a1-bf0b6b296259 req-a9ba4533-74c7-485c-b597-fff2f3725787 tempest-TestShelveInstance-1859733100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c162cc67-fcf4-4029-8176-4f9e7fa24c18', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:44:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-2ebb96c9-011c-42d5-94a1-bf0b6b296259 req-a9ba4533-74c7-485c-b597-fff2f3725787 tempest-TestShelveInstance-1859733100 None] attachment_update completed successfully. Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Acquiring lock "cinder-2deb4ef2-9b14-42cd-aabb-25fc480a303a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Lock "cinder-2deb4ef2-9b14-42cd-aabb-25fc480a303a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Acquiring lock "cinder-quobyte-2deb4ef2-9b14-42cd-aabb-25fc480a303a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Lock "cinder-quobyte-2deb4ef2-9b14-42cd-aabb-25fc480a303a" acquired by "delete_volume" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb593e5-4c49-484d-b137-9b1500036e63]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:39 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a Aug 05 15:44:39 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:39 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a" returned: 0 in 0.529s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:40 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a Aug 05 15:44:40 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:40 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2deb4ef2-9b14-42cd-aabb-25fc480a303a" returned: 0 in 0.739s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Lock "cinder-quobyte-2deb4ef2-9b14-42cd-aabb-25fc480a303a" released by "delete_volume" :: held 1.341s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Created reservations ['9b7ed8c6-80d4-48c4-b14d-1c72fb0f8d38', '0433f094-3842-4220-9e4e-a9daeeb7066f', '971bf004-dda7-479d-b15d-bf87b66afe70', '5820ea9e-8318-42c0-808a-2d99312c29c3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Flow 'volume_create_manager' (16c971eb-76a4-4d30-a5cf-6dc2f85f261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4275d6c6-edbe-4c1b-9a9a-9ce084fd4fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4275d6c6-edbe-4c1b-9a9a-9ce084fd4fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-147422018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a5ab53-80fd-4aec-b729-72082629b415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fa6bf00371405fbfc596024327a118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:41Z,use_quota=True,user_id='3aecfbb5b7b648fa8cb840255a6e9555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7909138a-f7a3-419b-91fa-6da5326cfdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7909138a-f7a3-419b-91fa-6da5326cfdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15eb08-af43-4aa8-a252-f1f9fd02e56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd15eb08-af43-4aa8-a252-f1f9fd02e56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a5ab53-80fd-4aec-b729-72082629b415', 'volume_name': 'volume-e3a5ab53-80fd-4aec-b729-72082629b415', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874cefa5-44e1-41cc-96d5-2709f2ab1130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874cefa5-44e1-41cc-96d5-2709f2ab1130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea4ed09-babf-4bb9-bb5d-df3f2963cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Volume e3a5ab53-80fd-4aec-b729-72082629b415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a5ab53-80fd-4aec-b729-72082629b415', 'volume_size': 1} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-147422018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a5ab53-80fd-4aec-b729-72082629b415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fa6bf00371405fbfc596024327a118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:41Z,use_quota=True,user_id='3aecfbb5b7b648fa8cb840255a6e9555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Creating volume e3a5ab53-80fd-4aec-b729-72082629b415 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:41 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:41 devstack sudo[102020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 1073741824 Aug 05 15:44:41 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:41 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:41 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Flow 'volume_create_manager' (5de67bfe-6a56-45ef-9074-b19136a280d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976ee1da-32e5-4414-b841-9dc5a3e9fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (976ee1da-32e5-4414-b841-9dc5a3e9fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1470717844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97ae145-ad74-47fc-8883-783dc577baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33b7008a3044cb68483688f671c8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:41Z,use_quota=True,user_id='4f77bcf0c5604a81955260765127fe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae190c0-cda0-4bbe-8b09-997ce2e00799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ae190c0-cda0-4bbe-8b09-997ce2e00799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5076dc42-c099-4a4c-81e3-c9f20b56212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:44:41 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.528s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Deleted volume successfully. Aug 05 15:44:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c78a4da-8a27-4273-a84a-02f6c2d82ec0 tempest-VolumesNegativeTest-1152611177 None] Lock "cinder-2deb4ef2-9b14-42cd-aabb-25fc480a303a-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:42 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 1073741824" returned: 0 in 0.989s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:42 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 Aug 05 15:44:42 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5076dc42-c099-4a4c-81e3-c9f20b56212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f97ae145-ad74-47fc-8883-783dc577baf7', 'volume_name': 'volume-f97ae145-ad74-47fc-8883-783dc577baf7', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ef43c1-26d7-4cde-ad99-76781f504e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ef43c1-26d7-4cde-ad99-76781f504e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce385343-6e85-49dc-a8c9-e2a6d928af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:42 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Volume f97ae145-ad74-47fc-8883-783dc577baf7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f97ae145-ad74-47fc-8883-783dc577baf7', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Trying to clone f97ae145-ad74-47fc-8883-783dc577baf7 from image 84e9902b-fdcb-400c-bb6e-673761bd149d at location (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:44:42 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea4ed09-babf-4bb9-bb5d-df3f2963cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a5ab53-80fd-4aec-b729-72082629b415', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ab5b41-2780-44f4-9ff7-b4ba4abf7474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:42 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Volume volume-e3a5ab53-80fd-4aec-b729-72082629b415 (e3a5ab53-80fd-4aec-b729-72082629b415): created successfully Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ab5b41-2780-44f4-9ff7-b4ba4abf7474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Flow 'volume_create_manager' (16c971eb-76a4-4d30-a5cf-6dc2f85f261d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-35ad5626-bfe9-424e-9b15-5ba55c1d04c5 tempest-VolumeQuotasAdminTestJSON-533438395 None] Created volume successfully. Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:44:42 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f025b606-af60-4ca4-89ac-44784395c593]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:42 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD Aug 05 15:44:42 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:43 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d is fetched for user 4f77bcf0c5604a81955260765127fe44. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "cinder-e3a5ab53-80fd-4aec-b729-72082629b415-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "cinder-e3a5ab53-80fd-4aec-b729-72082629b415-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4326585-9516-4753-a1c6-435e7193402c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "cinder-quobyte-e3a5ab53-80fd-4aec-b729-72082629b415" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "cinder-quobyte-e3a5ab53-80fd-4aec-b729-72082629b415" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb475a-6286-438c-bcc1-a30df4644bff]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:43 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD Aug 05 15:44:43 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:43 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 Aug 05 15:44:43 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:43 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD" returned: 0 in 0.564s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1470717844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f97ae145-ad74-47fc-8883-783dc577baf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d33b7008a3044cb68483688f671c8cf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:41Z,use_quota=True,user_id='4f77bcf0c5604a81955260765127fe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Creating volume f97ae145-ad74-47fc-8883-783dc577baf7 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:44 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:44 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 1073741824 Aug 05 15:44:44 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:44 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415" returned: 0 in 0.590s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:44 devstack sudo[102094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415 Aug 05 15:44:44 devstack sudo[102094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:44 devstack sudo[102094]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e3a5ab53-80fd-4aec-b729-72082629b415" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "cinder-quobyte-e3a5ab53-80fd-4aec-b729-72082629b415" released by "delete_volume" :: held 0.958s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Created reservations ['3cef0512-2614-49fc-9809-2c856754001e', '6ebe9a79-92db-41de-95d4-6fd2395fc9ea', 'c916adfc-2900-4217-a2b1-b28fa7b24a76', 'f6d73663-cc9d-4c45-a8f5-4d90eda541ef'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:44 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 1073741824" returned: 0 in 0.765s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:44 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:44 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:44 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 Aug 05 15:44:44 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:45 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Deleted volume successfully. Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0737518c-6a48-4926-9900-4ed13b748403 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "cinder-e3a5ab53-80fd-4aec-b729-72082629b415-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:45 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7" returned: 0 in 0.397s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Attempting download of 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume f97ae145-ad74-47fc-8883-783dc577baf7. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f16b69-b6c9-496f-a8e1-4b167287f4a3]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:45 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr Aug 05 15:44:45 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Flow 'volume_create_manager' (677874aa-993c-4b94-8d16-cd99bb5ad5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3d7ccf-5f3f-4ab2-b617-cb10cf557d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3d7ccf-5f3f-4ab2-b617-cb10cf557d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-224984263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cd26e285ce4badb1a1becaf1749a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:46Z,use_quota=True,user_id='26b3ecdd56ad43b8ab16702f84fb2422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4df88c-02b7-45e6-b432-f09ad54ef91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4df88c-02b7-45e6-b432-f09ad54ef91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b0e88f-ff67-4087-bbb6-e693eb06140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b0e88f-ff67-4087-bbb6-e693eb06140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b', 'volume_name': 'volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdf7b14-035f-4f97-a04c-22826d15829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffdf7b14-035f-4f97-a04c-22826d15829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de6cddf-48f0-4ace-a15d-81b84a284172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:45 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b', 'volume_size': 1} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-224984263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95cd26e285ce4badb1a1becaf1749a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:46Z,use_quota=True,user_id='26b3ecdd56ad43b8ab16702f84fb2422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Creating volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:45 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:45 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b 1073741824 Aug 05 15:44:45 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:45 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr" returned: 0 in 0.474s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:45 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr Aug 05 15:44:45 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:46 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr" returned: 1 in 0.435s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_i25to6yr' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5f4898-4ab7-4c3f-804c-ce30688e3d95]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:46 devstack sudo[102120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD Aug 05 15:44:46 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:46 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b 1073741824" returned: 0 in 0.781s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Flow 'volume_create_manager' (6e4e7d03-7b5d-4cc9-a26b-240c43f44908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e82551-8810-4419-b495-10326dc355b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e82551-8810-4419-b495-10326dc355b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469869801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c2175e-84b7-4ab6-bf03-cb05bbc61ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fa6bf00371405fbfc596024327a118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:46Z,use_quota=True,user_id='3aecfbb5b7b648fa8cb840255a6e9555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f03e702-5e10-41a1-a280-d8a66d868413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f03e702-5e10-41a1-a280-d8a66d868413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d66707b-6f81-4bee-b18c-8812c7617396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d66707b-6f81-4bee-b18c-8812c7617396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c2175e-84b7-4ab6-bf03-cb05bbc61ca0', 'volume_name': 'volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbbabc7-84d3-44de-8452-cd89090cabcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbbabc7-84d3-44de-8452-cd89090cabcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b26e2d5-2ff8-4c14-812b-db59bbcb791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:46 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Volume 74c2175e-84b7-4ab6-bf03-cb05bbc61ca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0', 'volume_size': 1} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:46 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] 84e9902b-fdcb-400c-bb6e-673761bd149d was qcow2, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:46 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b Aug 05 15:44:46 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:46 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 Aug 05 15:44:46 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:46 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" returned: 0 in 0.286s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.312s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1469869801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c2175e-84b7-4ab6-bf03-cb05bbc61ca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58fa6bf00371405fbfc596024327a118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:44:46Z,use_quota=True,user_id='3aecfbb5b7b648fa8cb840255a6e9555',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Creating volume 74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:46 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de6cddf-48f0-4ace-a15d-81b84a284172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877c57bf-fcea-4d30-8418-17ccefcf746a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:47 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 1073741824 Aug 05 15:44:47 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Volume volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b (fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b): created successfully Aug 05 15:44:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (877c57bf-fcea-4d30-8418-17ccefcf746a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Flow 'volume_create_manager' (677874aa-993c-4b94-8d16-cd99bb5ad5e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-17e60085-5ab7-4cd4-b139-ed9b9e509a18 tempest-VolumesSnapshotListTestJSON-295085030 None] Created volume successfully. Aug 05 15:44:47 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 1073741824" returned: 0 in 0.638s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:47 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 Aug 05 15:44:47 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:48 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0" returned: 0 in 0.382s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b26e2d5-2ff8-4c14-812b-db59bbcb791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9e8f95-df08-4125-b9d9-f16202f70bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Creating offline snapshot bfbac8b7-0840-4146-ae54-ae32be1c567c of volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:44:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Volume volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 (74c2175e-84b7-4ab6-bf03-cb05bbc61ca0): created successfully Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9e8f95-df08-4125-b9d9-f16202f70bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Flow 'volume_create_manager' (6e4e7d03-7b5d-4cc9-a26b-240c43f44908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[807121f8-c417-4ee2-8703-cc66a0d12b1e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1fcd30fb-ab7a-40bc-ac1f-738c707d1209 tempest-VolumeQuotasAdminTestJSON-533438395 None] Created volume successfully. Aug 05 15:44:48 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b Aug 05 15:44:48 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:48 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" returned: 0 in 0.491s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:48 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c 1G Aug 05 15:44:48 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:48 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7" returned: 0 in 2.101s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_u1wd1ij0devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:44:48 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Converted 112.00 MB image at 53.27 MB/s Aug 05 15:44:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:48 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 1G Aug 05 15:44:48 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:49 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 1G" returned: 0 in 0.424s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Downloaded image 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume f97ae145-ad74-47fc-8883-783dc577baf7 successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d for user 4f77bcf0c5604a81955260765127fe44 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Marking volume f97ae145-ad74-47fc-8883-783dc577baf7 as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Copying metadata from image 84e9902b-fdcb-400c-bb6e-673761bd149d to f97ae145-ad74-47fc-8883-783dc577baf7. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Creating volume glance metadata for volume f97ae145-ad74-47fc-8883-783dc577baf7 backed by image 84e9902b-fdcb-400c-bb6e-673761bd149d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:44:49 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c 1G" returned: 0 in 0.656s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:49 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:44:49 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce385343-6e85-49dc-a8c9-e2a6d928af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f97ae145-ad74-47fc-8883-783dc577baf7', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6794482-ade4-48b1-9e5d-7adfb34a4c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:49 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Volume volume-f97ae145-ad74-47fc-8883-783dc577baf7 (f97ae145-ad74-47fc-8883-783dc577baf7): created successfully Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6794482-ade4-48b1-9e5d-7adfb34a4c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Flow 'volume_create_manager' (5de67bfe-6a56-45ef-9074-b19136a280d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f2e4cbd9-6f6e-4aa6-9b78-056f78d49e75 tempest-VolumesImageMetadata-826655747 None] Created volume successfully. Aug 05 15:44:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1c4a1ce8-6e06-464a-aa03-b00d45191ee3 tempest-VolumeQuotasAdminTestJSON-1042159307 None] Transfer volume completed successfully. Aug 05 15:44:49 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.366s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:49 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c is being set with open permissions: ugo+rw Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:49 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:44:49 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:49 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.249s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:49 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info Aug 05 15:44:49 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Acquiring lock "cinder-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Lock "cinder-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Acquiring lock "cinder-quobyte-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Lock "cinder-quobyte-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfde9e8e-a2d0-42b2-a448-7231d4102608]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:50 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info" returned: 0 in 0.308s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:50 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info is being set with open permissions: ugo+rw Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:50 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info Aug 05 15:44:50 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:50 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 Aug 05 15:44:50 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:50 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.info" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.542s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:50 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:50 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0 Aug 05 15:44:50 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:50 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8ba867bc-22e5-406d-982e-2a922f1faf3e tempest-VolumesSnapshotListTestJSON-295085030 None] Create snapshot completed successfully Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Acquiring lock "cinder-f97ae145-ad74-47fc-8883-783dc577baf7-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Lock "cinder-f97ae145-ad74-47fc-8883-783dc577baf7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Acquiring lock "cinder-quobyte-f97ae145-ad74-47fc-8883-783dc577baf7" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Lock "cinder-quobyte-f97ae145-ad74-47fc-8883-783dc577baf7" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedad1c6-45b2-46c3-83f2-a148feae38d1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:50 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0" returned: 0 in 0.292s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:50 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 Aug 05 15:44:50 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Lock "cinder-quobyte-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0" released by "delete_volume" :: held 0.738s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:50 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Created reservations ['1d2e3ee1-6047-41a9-981e-0b26fa37e61a', 'a7969a50-2cbe-4098-8f2a-90ef917ea93d', 'ff910406-2fa3-4135-90e7-e628a9e205a7', '9fdb7623-cf9b-410e-933f-4c475167ea76'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:51 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:51 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:51 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7" returned: 0 in 0.384s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:51 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7 Aug 05 15:44:51 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:51 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.406s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Deleted volume successfully. Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-448d6650-a17e-45e4-9a97-8b0d50d07a17 tempest-VolumeQuotasAdminTestJSON-933888047 None] Lock "cinder-74c2175e-84b7-4ab6-bf03-cb05bbc61ca0-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Creating offline snapshot 89964ca1-a29a-4793-8486-1c7ca32d7fdb of volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:44:51 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f97ae145-ad74-47fc-8883-783dc577baf7" returned: 0 in 0.448s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3355f53-c972-4caf-b500-790e70fc3d81]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Lock "cinder-quobyte-f97ae145-ad74-47fc-8883-783dc577baf7" released by "delete_volume" :: held 0.896s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Created reservations ['9521775d-06c1-4f93-a4c6-9932760c2274', '1e763471-34d1-486a-b316-7e72944b66a9', '4958427d-ebab-4d26-a3f5-1c790a1b027c', 'a35f5f9d-08f7-4b76-b375-1b5bebb625a8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:44:51 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:44:51 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:51 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:44:51 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:52 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.533s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:52 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb 1G Aug 05 15:44:52 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:52 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.402s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:44:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Deleted volume successfully. Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-01d038c0-1dfa-4655-bdf8-1038e326153b tempest-VolumesImageMetadata-826655747 None] Lock "cinder-f97ae145-ad74-47fc-8883-783dc577baf7-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:44:52 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb 1G" returned: 0 in 0.638s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:52 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:44:52 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:53 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:53 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb is being set with open permissions: ugo+rw Aug 05 15:44:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:53 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:44:53 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:53 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.347s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-85befaf6-8272-4902-b3ff-a19829b22630 tempest-VolumesSnapshotListTestJSON-295085030 None] Create snapshot completed successfully Aug 05 15:44:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Creating offline snapshot 53d372ac-97d8-48ac-bdad-6e4ba9bc972a of volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:44:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b39893-6e6c-48ca-8560-8c76cb036d15]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:55 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:44:55 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:55 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.504s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:44:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:55 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a 1G Aug 05 15:44:55 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:56 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a 1G" returned: 0 in 0.703s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:56 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a Aug 05 15:44:56 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:56 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a" returned: 0 in 0.429s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:56 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a is being set with open permissions: ugo+rw Aug 05 15:44:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:56 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a Aug 05 15:44:56 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:57 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a" returned: 0 in 0.368s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4b6c5c74-f4aa-4277-889e-6cf069f23d83 tempest-VolumesSnapshotListTestJSON-295085030 None] Create snapshot completed successfully Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-53d372ac-97d8-48ac-bdad-6e4ba9bc972a-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-53d372ac-97d8-48ac-bdad-6e4ba9bc972a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-53d372ac-97d8-48ac-bdad-6e4ba9bc972a" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-53d372ac-97d8-48ac-bdad-6e4ba9bc972a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Deleting offline snapshot 53d372ac-97d8-48ac-bdad-6e4ba9bc972a of volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] snapshot_file for this snap is: volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd54ed91-f41b-4432-98d2-b86046dfd975]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:44:59 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a Aug 05 15:44:59 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Flow 'volume_create_manager' (367d0b96-32e2-42ef-84d1-eb9490d4c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b23c79-6bb3-4eb7-aa0e-1d5a06860818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b23c79-6bb3-4eb7-aa0e-1d5a06860818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2123746473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8672d6-6dcb-492d-88e8-fab2537e6c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1297175d3b41aab757152ba93bb778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:00Z,use_quota=True,user_id='e0e5b13b6adf4ca5b5fead5e58547bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eef590-8041-4ee0-8c7b-f44b5a5e66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03eef590-8041-4ee0-8c7b-f44b5a5e66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87321015-ab76-463c-b53e-265e09314de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87321015-ab76-463c-b53e-265e09314de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8672d6-6dcb-492d-88e8-fab2537e6c11', 'volume_name': 'volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3a02bc-e8ad-406c-90dc-28c95f2f7347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3a02bc-e8ad-406c-90dc-28c95f2f7347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d2b229-57b4-489e-95a7-f7f8ee45e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:44:59 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Volume 3f8672d6-6dcb-492d-88e8-fab2537e6c11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11', 'volume_size': 1} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:44:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2123746473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8672d6-6dcb-492d-88e8-fab2537e6c11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1297175d3b41aab757152ba93bb778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:00Z,use_quota=True,user_id='e0e5b13b6adf4ca5b5fead5e58547bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Creating volume 3f8672d6-6dcb-492d-88e8-fab2537e6c11 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:44:59 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:44:59 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 1073741824 Aug 05 15:44:59 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:44:59 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a" returned: 0 in 0.460s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0f6023-d12b-410e-adcb-03ba615f1d52]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:44:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:00 devstack sudo[102258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:45:00 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:00 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 1073741824" returned: 0 in 0.528s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:00 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.381s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:00 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a Aug 05 15:45:00 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:00 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 Aug 05 15:45:00 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Flow 'volume_create_manager' (14542827-5f64-44ab-80be-cf661204819e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e21666-3c82-4683-8fc5-8409805de892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e21666-3c82-4683-8fc5-8409805de892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-563949478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6162e8a2-2206-4484-8460-d8beb2b5b543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3944ac34384066b42c3fde122beece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:00Z,use_quota=True,user_id='03534351103044d5913294862bfba12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eed9cb4-3f25-458f-887e-e68d1e95a8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eed9cb4-3f25-458f-887e-e68d1e95a8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466363f7-51ea-4125-aef2-0c242f7b36e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466363f7-51ea-4125-aef2-0c242f7b36e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6162e8a2-2206-4484-8460-d8beb2b5b543', 'volume_name': 'volume-6162e8a2-2206-4484-8460-d8beb2b5b543', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a9635e-f1f0-4e04-b4b4-7ee408e564e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a9635e-f1f0-4e04-b4b4-7ee408e564e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b17c7d-fc16-4680-931a-7734a03dd58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:00 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Volume 6162e8a2-2206-4484-8460-d8beb2b5b543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6162e8a2-2206-4484-8460-d8beb2b5b543', 'volume_size': 1} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:00 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11" returned: 0 in 0.268s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-563949478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6162e8a2-2206-4484-8460-d8beb2b5b543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3944ac34384066b42c3fde122beece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:00Z,use_quota=True,user_id='03534351103044d5913294862bfba12e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Creating volume 6162e8a2-2206-4484-8460-d8beb2b5b543 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:00 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:00 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 1073741824 Aug 05 15:45:00 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9d2b229-57b4-489e-95a7-f7f8ee45e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f4c79d-1cc1-4e9d-9fcc-4a6978bed5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:00 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Volume volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 (3f8672d6-6dcb-492d-88e8-fab2537e6c11): created successfully Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f4c79d-1cc1-4e9d-9fcc-4a6978bed5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Flow 'volume_create_manager' (367d0b96-32e2-42ef-84d1-eb9490d4c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:00 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a180ea0c-4eaa-4a4b-9029-c78fcfc3e948 tempest-VolumesMetadataTest-2099841082 None] Created volume successfully. Aug 05 15:45:00 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a" returned: 0 in 0.471s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:00 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a Aug 05 15:45:00 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:01 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 1073741824" returned: 0 in 0.407s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:01 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.53d372ac-97d8-48ac-bdad-6e4ba9bc972a" returned: 0 in 0.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-53d372ac-97d8-48ac-bdad-6e4ba9bc972a" released by "_delete_snapshot" :: held 1.667s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" released by "delete_snapshot" :: held 1.696s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:01 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 Aug 05 15:45:01 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Created reservations ['2905ef00-5095-4934-b772-19fc2f54fa34', 'd206e01d-bf9a-483d-8e6e-8636ca834313', '0eb720af-3b5d-421f-b7e0-effebddbeead', '70969607-3bcd-4023-bf5d-38bb9ed71467'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Delete snapshot completed successfully. Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-381a4d0d-5bfa-4abe-a007-1b7557586793 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-53d372ac-97d8-48ac-bdad-6e4ba9bc972a-delete_snapshot" released by "delete_snapshot" :: held 1.855s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:01 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543" returned: 0 in 0.245s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b17c7d-fc16-4680-931a-7734a03dd58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6162e8a2-2206-4484-8460-d8beb2b5b543', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecdbaf4-0473-4c57-bac6-9b057d623696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:01 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Volume volume-6162e8a2-2206-4484-8460-d8beb2b5b543 (6162e8a2-2206-4484-8460-d8beb2b5b543): created successfully Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fecdbaf4-0473-4c57-bac6-9b057d623696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Flow 'volume_create_manager' (14542827-5f64-44ab-80be-cf661204819e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0cf8d905-f9cb-4684-a054-a08abf63aeac tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Created volume successfully. Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-89964ca1-a29a-4793-8486-1c7ca32d7fdb-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-89964ca1-a29a-4793-8486-1c7ca32d7fdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-89964ca1-a29a-4793-8486-1c7ca32d7fdb" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-89964ca1-a29a-4793-8486-1c7ca32d7fdb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Deleting offline snapshot 89964ca1-a29a-4793-8486-1c7ca32d7fdb of volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] snapshot_file for this snap is: volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[56003092-064a-4192-910b-df4936006567]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:01 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:45:01 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:02 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.386s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef4fa1e-6b6f-4caa-938b-39c85e68be16]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:02 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:45:02 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Acquiring lock "cinder-3f8672d6-6dcb-492d-88e8-fab2537e6c11-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Lock "cinder-3f8672d6-6dcb-492d-88e8-fab2537e6c11-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Acquiring lock "cinder-quobyte-3f8672d6-6dcb-492d-88e8-fab2537e6c11" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Lock "cinder-quobyte-3f8672d6-6dcb-492d-88e8-fab2537e6c11" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a0005f-08bc-45d2-8f1b-45586d3f696d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:02 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.409s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:02 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:45:02 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:02 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 Aug 05 15:45:02 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:03 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11" returned: 0 in 0.405s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:03 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:03 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11 Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:03 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:03 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb Aug 05 15:45:03 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:03 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3f8672d6-6dcb-492d-88e8-fab2537e6c11" returned: 0 in 0.253s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Lock "cinder-quobyte-3f8672d6-6dcb-492d-88e8-fab2537e6c11" released by "delete_volume" :: held 0.704s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Created reservations ['eac783bb-5c0d-4bfc-badb-ef1f4f191b27', '74566396-a84d-49c2-9774-8758dcf32e83', '7dcd60a8-fe92-4f9f-88b1-7ab8e2189011', 'f8aea877-0dda-4d63-955b-c89f6b1ca46f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:03 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.89964ca1-a29a-4793-8486-1c7ca32d7fdb" returned: 0 in 0.293s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-89964ca1-a29a-4793-8486-1c7ca32d7fdb" released by "_delete_snapshot" :: held 1.591s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" released by "delete_snapshot" :: held 1.624s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:03 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:03 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Created reservations ['8146c2ed-33a2-4d54-8467-8d4d9f511a27', 'df02f97b-979d-4ede-becd-7fa75dba02f5', 'e4979823-d184-4977-ad6e-f82156ac53ab', '986aee0a-d51d-4ad8-81c2-be0aa0c8dbcd'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Delete snapshot completed successfully. Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6d52a4b9-0464-4009-9450-d36541dd4104 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-89964ca1-a29a-4793-8486-1c7ca32d7fdb-delete_snapshot" released by "delete_snapshot" :: held 1.817s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Acquiring lock "cinder-6162e8a2-2206-4484-8460-d8beb2b5b543-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "cinder-6162e8a2-2206-4484-8460-d8beb2b5b543-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Acquiring lock "cinder-quobyte-6162e8a2-2206-4484-8460-d8beb2b5b543" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "cinder-quobyte-6162e8a2-2206-4484-8460-d8beb2b5b543" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc29feb5-2573-49b8-8bc2-0b29fa021683]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:03 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.285s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Deleted volume successfully. Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ee70abe5-3585-4e77-b0e6-398e6cebc1e7 tempest-VolumesMetadataTest-2099841082 None] Lock "cinder-3f8672d6-6dcb-492d-88e8-fab2537e6c11-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:03 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 Aug 05 15:45:03 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-bfbac8b7-0840-4146-ae54-ae32be1c567c-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-bfbac8b7-0840-4146-ae54-ae32be1c567c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-bfbac8b7-0840-4146-ae54-ae32be1c567c" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-bfbac8b7-0840-4146-ae54-ae32be1c567c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Deleting offline snapshot bfbac8b7-0840-4146-ae54-ae32be1c567c of volume fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:45:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] snapshot_file for this snap is: volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad6a5fd-8cf0-4c08-8d6d-b384d4ff1fcc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:04 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543" returned: 0 in 0.435s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:04 devstack sudo[102345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:45:04 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:04 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543 Aug 05 15:45:04 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:04 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6162e8a2-2206-4484-8460-d8beb2b5b543" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:04 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.441s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "cinder-quobyte-6162e8a2-2206-4484-8460-d8beb2b5b543" released by "delete_volume" :: held 0.812s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7b6390-13af-4f9d-b1eb-f77431390a1c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Created reservations ['602961bf-c982-4f08-8c01-7e62266c2dbc', '73010868-0a80-4f93-bcdd-681f60c92324', '3bd400f1-3299-4055-9a58-9b11c95ee883', '64481feb-d449-4491-b65c-cf989ea509c2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:04 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b Aug 05 15:45:04 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:04 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:04 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:04 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" returned: 0 in 0.475s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:04 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:45:04 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:05 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.372s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:05 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Deleted volume successfully. Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f464f07d-5581-4969-8f57-a5710cc6e521 tempest-VolumeQuotasNegativeTestJSON-1495890970 None] Lock "cinder-6162e8a2-2206-4484-8460-d8beb2b5b543-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:05 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.476s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:05 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c Aug 05 15:45:05 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:05 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b.bfbac8b7-0840-4146-ae54-ae32be1c567c" returned: 0 in 0.326s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-bfbac8b7-0840-4146-ae54-ae32be1c567c" released by "_delete_snapshot" :: held 1.867s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" released by "delete_snapshot" :: held 1.900s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:05 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Created reservations ['50cf63bf-414f-432c-8200-c325671425cf', '6d00bdda-6904-43c3-af0d-c62d6c81183d', '09bfa34d-3097-4d07-9b95-f00427dd99fa', 'b2866ab9-c328-41b6-983a-ba9ac049aae7'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:06 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Delete snapshot completed successfully. Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-928fd383-234c-4172-9eef-bdcdb04a3e23 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-bfbac8b7-0840-4146-ae54-ae32be1c567c-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9e365a-9860-46fb-9015-425799bbc719]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:06 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b Aug 05 15:45:06 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:06 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" returned: 0 in 0.525s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:06 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b Aug 05 15:45:06 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:07 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" returned: 0 in 0.308s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-quobyte-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b" released by "delete_volume" :: held 0.913s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Created reservations ['a9b8d1f5-2f4e-4166-bf29-dceaeda5ab03', 'e63dd157-75ba-4d64-9b4f-04651c16f8df', '632bdf90-c016-45d4-8a43-641eb923f2e8', 'd1dc54da-0ea9-4438-9681-b4703f2c272c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:07 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:07 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:07 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Deleted volume successfully. Aug 05 15:45:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1d3999a0-90ed-4f59-98d7-db62520d71b6 tempest-VolumesSnapshotListTestJSON-295085030 None] Lock "cinder-fb8ff906-48d5-4ba1-9fa4-118cccb6fb0b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Flow 'volume_create_manager' (2f9fee93-4640-4b13-a93e-a3a897233d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d17a56-8f3b-43e7-ad5b-5b82b7909874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d17a56-8f3b-43e7-ad5b-5b82b7909874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1662450929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82a0067-3378-45d4-a19e-2c008d95d4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88d64bd81cd40638532ae52ed3e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:08Z,use_quota=True,user_id='f2ed8154485144fbb3f21a421e496ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3862c332-e036-4cf7-9dbe-ccd8cd1feaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3862c332-e036-4cf7-9dbe-ccd8cd1feaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb30c1-7449-4864-97b3-6d15f2f7dc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bb30c1-7449-4864-97b3-6d15f2f7dc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a82a0067-3378-45d4-a19e-2c008d95d4d3', 'volume_name': 'volume-a82a0067-3378-45d4-a19e-2c008d95d4d3', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b33b540-4d9b-42ce-9bc1-bd42c03bf3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b33b540-4d9b-42ce-9bc1-bd42c03bf3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7268629d-b222-4152-a6e4-9fe70d742b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Volume a82a0067-3378-45d4-a19e-2c008d95d4d3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a82a0067-3378-45d4-a19e-2c008d95d4d3', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Trying to clone a82a0067-3378-45d4-a19e-2c008d95d4d3 from image 84e9902b-fdcb-400c-bb6e-673761bd149d at location (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:45:08 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:45:08 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[266a0262-945b-4220-9c8e-03cd79c098d6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:09 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD Aug 05 15:45:09 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:09 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d is fetched for user f2ed8154485144fbb3f21a421e496ff9. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2553e7a4-c950-4d84-a171-c39c0f8318a0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:09 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD Aug 05 15:45:09 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:09 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1662450929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82a0067-3378-45d4-a19e-2c008d95d4d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88d64bd81cd40638532ae52ed3e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:08Z,use_quota=True,user_id='f2ed8154485144fbb3f21a421e496ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Creating volume a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:09 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:09 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 1073741824 Aug 05 15:45:09 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:10 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:10 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:10 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:45:10 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 1073741824" returned: 0 in 0.628s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=120,cinder:UPDATE=142,cinder:DELETE=12,cinder:INSERT=35 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:10 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 Aug 05 15:45:10 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:10 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3" returned: 0 in 0.333s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Attempting download of 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume a82a0067-3378-45d4-a19e-2c008d95d4d3. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded75f64-8d68-4e31-b8bf-7f8af97c5b61]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:11 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg Aug 05 15:45:11 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:11 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg" returned: 0 in 0.371s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:11 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg Aug 05 15:45:11 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:11 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg" returned: 1 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_heqf0xlg' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:45:11 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93d9a7-edf4-4de5-a7fc-ad9133e115e0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:11 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD Aug 05 15:45:11 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:12 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] 84e9902b-fdcb-400c-bb6e-673761bd149d was qcow2, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:12 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 Aug 05 15:45:12 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=137,cinder:SELECT=124,cinder:INSERT=44,cinder:DELETE=7 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Flow 'volume_create_manager' (ed05185b-4330-469c-acb3-fba8362ba140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0477adb3-09a7-4b19-bdb4-423ec2ac1435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0477adb3-09a7-4b19-bdb4-423ec2ac1435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1235560258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a71ede-e93b-4718-bc58-a1a911017998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d284acee114dd9b57b73734e64e008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:12Z,use_quota=True,user_id='8a198e916a294f3196fd0d759ff485b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1686ed89-3c03-468a-a3b7-44a64cf96a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1686ed89-3c03-468a-a3b7-44a64cf96a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a5a4ea-c660-46b0-a9c7-95af3e00b069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a5a4ea-c660-46b0-a9c7-95af3e00b069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a71ede-e93b-4718-bc58-a1a911017998', 'volume_name': 'volume-14a71ede-e93b-4718-bc58-a1a911017998', 'volume_size': 2}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6404877-3954-477f-959a-41305b4435ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6404877-3954-477f-959a-41305b4435ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50453fa8-6dfd-4a00-842d-998c65c206cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:12 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Volume 14a71ede-e93b-4718-bc58-a1a911017998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a71ede-e93b-4718-bc58-a1a911017998', 'volume_size': 2} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1235560258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a71ede-e93b-4718-bc58-a1a911017998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18d284acee114dd9b57b73734e64e008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:12Z,use_quota=True,user_id='8a198e916a294f3196fd0d759ff485b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Creating volume 14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:12 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 2147483648 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:12 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 2147483648 Aug 05 15:45:12 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:12 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 2147483648" returned: 0 in 0.538s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:12 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 Aug 05 15:45:12 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:13 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998" returned: 0 in 0.287s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50453fa8-6dfd-4a00-842d-998c65c206cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a71ede-e93b-4718-bc58-a1a911017998', 'volume_size': 2}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cfd6a0-93f7-47c7-8466-628c143d4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Volume volume-14a71ede-e93b-4718-bc58-a1a911017998 (14a71ede-e93b-4718-bc58-a1a911017998): created successfully Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cfd6a0-93f7-47c7-8466-628c143d4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Flow 'volume_create_manager' (ed05185b-4330-469c-acb3-fba8362ba140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e9f707ff-83fc-4b2e-9386-569b7e7f472f tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Created volume successfully. Aug 05 15:45:14 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3" returned: 0 in 2.033s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_k_nx083odevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:45:14 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Converted 112.00 MB image at 55.03 MB/s Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:14 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 1G Aug 05 15:45:14 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Creating offline snapshot 0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce of volume 14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[448388d3-8850-47c6-92b2-697784062755]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:14 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 1G" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Downloaded image 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume a82a0067-3378-45d4-a19e-2c008d95d4d3 successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d for user f2ed8154485144fbb3f21a421e496ff9 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Marking volume a82a0067-3378-45d4-a19e-2c008d95d4d3 as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Copying metadata from image 84e9902b-fdcb-400c-bb6e-673761bd149d to a82a0067-3378-45d4-a19e-2c008d95d4d3. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Creating volume glance metadata for volume a82a0067-3378-45d4-a19e-2c008d95d4d3 backed by image 84e9902b-fdcb-400c-bb6e-673761bd149d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:45:14 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 Aug 05 15:45:14 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7268629d-b222-4152-a6e4-9fe70d742b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82a0067-3378-45d4-a19e-2c008d95d4d3', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82582c4a-af2f-493d-8651-476cc81c3414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Volume volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 (a82a0067-3378-45d4-a19e-2c008d95d4d3): created successfully Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82582c4a-af2f-493d-8651-476cc81c3414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Flow 'volume_create_manager' (2f9fee93-4640-4b13-a93e-a3a897233d3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-283e4180-72fa-4dc3-9f6c-cfc61c9c061e tempest-VolumesExtendTest-122876544 None] Created volume successfully. Aug 05 15:45:14 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998" returned: 0 in 0.423s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce 2G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:14 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce 2G Aug 05 15:45:14 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:15 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce 2G" returned: 0 in 0.543s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a71ede-e93b-4718-bc58-a1a911017998 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:15 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a71ede-e93b-4718-bc58-a1a911017998 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce Aug 05 15:45:15 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:15 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14a71ede-e93b-4718-bc58-a1a911017998 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" returned: 0 in 0.341s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:15 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce is being set with open permissions: ugo+rw Aug 05 15:45:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:15 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce Aug 05 15:45:15 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:16 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" returned: 0 in 0.278s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:16 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info Aug 05 15:45:16 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:16 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info" returned: 0 in 0.256s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:16 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info is being set with open permissions: ugo+rw Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:16 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info Aug 05 15:45:16 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:16 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.info" returned: 0 in 0.291s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.039s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[321929e3-7987-45f3-b53c-86f54015c432]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-71a5173a-8c85-40b5-9be1-9d5ecad12708 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Create snapshot completed successfully Aug 05 15:45:16 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 Aug 05 15:45:16 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:17 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3" returned: 0 in 0.408s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 2G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 2G" returned: 0 in 0.092s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.520s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0599c6b3-d79c-4e99-91bd-79663fe45583 tempest-VolumesExtendTest-122876544 None] Extend volume completed successfully. Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "cinder-0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "cinder-quobyte-14a71ede-e93b-4718-bc58-a1a911017998" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-quobyte-14a71ede-e93b-4718-bc58-a1a911017998" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "cinder-quobyte-0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-quobyte-0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Deleting offline snapshot 0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce of volume 14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] snapshot_file for this snap is: volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8fc6fd-1668-4764-ab87-2451bb7bb45d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:17 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce Aug 05 15:45:17 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-a82a0067-3378-45d4-a19e-2c008d95d4d3-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Lock "cinder-a82a0067-3378-45d4-a19e-2c008d95d4d3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-quobyte-a82a0067-3378-45d4-a19e-2c008d95d4d3" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-a82a0067-3378-45d4-a19e-2c008d95d4d3" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c58ec6-9bf7-49ed-966b-733b05cabe5f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:18 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" returned: 0 in 0.481s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14a71ede-e93b-4718-bc58-a1a911017998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e78aff6-bc2c-47e0-9894-ecbb89bc6152]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:18 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 Aug 05 15:45:18 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:18 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 Aug 05 15:45:18 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:18 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3" returned: 0 in 0.394s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:18 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3 Aug 05 15:45:18 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:18 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998" returned: 0 in 0.411s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:18 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce Aug 05 15:45:18 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:18 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a82a0067-3378-45d4-a19e-2c008d95d4d3" returned: 0 in 0.312s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-a82a0067-3378-45d4-a19e-2c008d95d4d3" released by "delete_volume" :: held 0.757s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Created reservations ['b11633d1-c43c-4fb7-9763-4b2aa8085753', '15afed81-6f9b-4474-a60f-aac28ae61dbb', 'aef62ff6-16d4-4b8c-a73b-9b74269cfeb5', '0d1150f5-339a-495a-b114-652cb4dab4c2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:19 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:19 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:19 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" returned: 0 in 0.454s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:19 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce Aug 05 15:45:19 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:19 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Deleted volume successfully. Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4d85808-6dc9-4e0f-9caf-a6c5a1594a3b tempest-VolumesExtendTest-122876544 None] Lock "cinder-a82a0067-3378-45d4-a19e-2c008d95d4d3-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:19 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998.0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" returned: 0 in 0.314s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-quobyte-0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce" released by "_delete_snapshot" :: held 1.814s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-quobyte-14a71ede-e93b-4718-bc58-a1a911017998" released by "delete_snapshot" :: held 1.845s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Created reservations ['b923ab9d-a3e1-4415-a2e1-40fc7b61267d', 'b4945dfb-381a-4f91-97c7-2558406ac581', '4e0c9f70-5511-4293-bf06-b2ebf380409a', 'c1977ef8-0682-4311-888d-33b150be1133'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Delete snapshot completed successfully. Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-708bb9b5-5660-413c-af84-e82157e327ca tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-0cf9c7cb-c52e-4bd0-af2b-4496e1c38fce-delete_snapshot" released by "delete_snapshot" :: held 2.044s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Flow 'volume_create_manager' (7072c255-2a0e-4567-ad9d-1d6311fe26da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c49a8f6-28bd-4968-a6d4-38d3e0b9fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c49a8f6-28bd-4968-a6d4-38d3e0b9fac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1626188477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a840d4e8-47d3-4cc3-81e1-723ce26984da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88d64bd81cd40638532ae52ed3e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:20Z,use_quota=True,user_id='f2ed8154485144fbb3f21a421e496ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1644a7e-99ef-4dd8-8511-a695bf7e683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1644a7e-99ef-4dd8-8511-a695bf7e683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d12a55-db87-478a-ae45-61a6748ea612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d12a55-db87-478a-ae45-61a6748ea612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a840d4e8-47d3-4cc3-81e1-723ce26984da', 'volume_name': 'volume-a840d4e8-47d3-4cc3-81e1-723ce26984da', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b93e0d4-0a04-4830-b839-5a4bd800dcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b93e0d4-0a04-4830-b839-5a4bd800dcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5a516b-7914-47a8-8603-f89e060d25eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Volume a840d4e8-47d3-4cc3-81e1-723ce26984da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a840d4e8-47d3-4cc3-81e1-723ce26984da', 'volume_size': 1} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1626188477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a840d4e8-47d3-4cc3-81e1-723ce26984da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a88d64bd81cd40638532ae52ed3e5e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:20Z,use_quota=True,user_id='f2ed8154485144fbb3f21a421e496ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Creating volume a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:20 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "cinder-14a71ede-e93b-4718-bc58-a1a911017998-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:20 devstack sudo[102561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da 1073741824 Aug 05 15:45:20 devstack sudo[102561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-14a71ede-e93b-4718-bc58-a1a911017998-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "cinder-quobyte-14a71ede-e93b-4718-bc58-a1a911017998" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-quobyte-14a71ede-e93b-4718-bc58-a1a911017998" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[60114cd1-0691-4968-97e6-adcc1cf08e22]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:20 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 Aug 05 15:45:20 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:20 devstack sudo[102561]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da 1073741824" returned: 0 in 0.490s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:20 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da Aug 05 15:45:20 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:20 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998" returned: 0 in 0.407s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:20 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998 Aug 05 15:45:20 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:20 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da" returned: 0 in 0.287s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5a516b-7914-47a8-8603-f89e060d25eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a840d4e8-47d3-4cc3-81e1-723ce26984da', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78544f81-3c7e-4f18-ad11-da07fd553026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Volume volume-a840d4e8-47d3-4cc3-81e1-723ce26984da (a840d4e8-47d3-4cc3-81e1-723ce26984da): created successfully Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78544f81-3c7e-4f18-ad11-da07fd553026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Flow 'volume_create_manager' (7072c255-2a0e-4567-ad9d-1d6311fe26da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-929a47ea-61d8-48dd-b025-2daae6993c45 tempest-VolumesExtendTest-122876544 None] Created volume successfully. Aug 05 15:45:20 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-14a71ede-e93b-4718-bc58-a1a911017998" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-quobyte-14a71ede-e93b-4718-bc58-a1a911017998" released by "delete_volume" :: held 0.770s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Created reservations ['183edd47-ad8e-42cb-b1ee-8bbd5f5c587e', 'ff6cbb11-17c4-441f-9502-d331bbfd6849', '1c3196bd-dbd9-4a45-b7e1-3b909e4d9d75', '10bb7fe3-6f79-4b07-bf2b-08d3514d4316'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:21 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:21 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:21 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.291s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Deleted volume successfully. Aug 05 15:45:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5c09ddc-6f15-40e4-a05c-68d247486352 tempest-VolumesSnapshotNegativeTestJSON-1235515539 None] Lock "cinder-14a71ede-e93b-4718-bc58-a1a911017998-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Creating offline snapshot 04070f56-002b-4691-93bb-13571cd6d74a of volume a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:45:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b041cc-e530-4448-830e-1a19e23013e9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:22 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da Aug 05 15:45:22 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:22 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da" returned: 0 in 0.606s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:23 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a 1G Aug 05 15:45:23 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:23 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a 1G" returned: 0 in 0.777s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a840d4e8-47d3-4cc3-81e1-723ce26984da -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:23 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a840d4e8-47d3-4cc3-81e1-723ce26984da -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a Aug 05 15:45:23 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:24 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a840d4e8-47d3-4cc3-81e1-723ce26984da -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a" returned: 0 in 0.472s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:24 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a is being set with open permissions: ugo+rw Aug 05 15:45:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:24 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a Aug 05 15:45:24 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:24 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a" returned: 0 in 0.417s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:24 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info Aug 05 15:45:24 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-c44027a6-81bc-4576-892c-cc88974abd30 tempest-TestShelveInstance-1859733100 None] Terminate volume connection completed successfully. Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-c44027a6-81bc-4576-892c-cc88974abd30 tempest-TestShelveInstance-1859733100 None] Deleting attachment c162cc67-fcf4-4029-8176-4f9e7fa24c18. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:45:25 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info" returned: 0 in 0.440s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:25 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info is being set with open permissions: ugo+rw Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:25 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info Aug 05 15:45:25 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:25 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.info" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.166s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6a661d8e-704a-47bd-ad73-a01e982a3226 tempest-VolumesExtendTest-122876544 None] Create snapshot completed successfully Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Acquiring lock "cinder-da5af7bf-4213-4375-9daa-f69b3fd99c3e-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Lock "cinder-da5af7bf-4213-4375-9daa-f69b3fd99c3e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Acquiring lock "cinder-quobyte-da5af7bf-4213-4375-9daa-f69b3fd99c3e" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Lock "cinder-quobyte-da5af7bf-4213-4375-9daa-f69b3fd99c3e" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d640df4-7a80-47be-a53a-1aabf1e2c3fb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:25 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e Aug 05 15:45:25 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Flow 'volume_create_manager' (94b51a7d-5c36-411c-b26b-f89f3707d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b482b8-638c-421e-ac38-e33f25bac22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b482b8-638c-421e-ac38-e33f25bac22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-834495941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25c982d-246b-43ce-884c-8e4a21c7315d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f78281612d463abddf31fcd5eedca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:26Z,use_quota=True,user_id='f63ea8d815114b659012dde6a3d090f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42bc787-3d7b-40bf-8ca9-0fea61c6f631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c42bc787-3d7b-40bf-8ca9-0fea61c6f631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f913ce28-dc75-4b9b-903b-3e81cc8e331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f913ce28-dc75-4b9b-903b-3e81cc8e331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a25c982d-246b-43ce-884c-8e4a21c7315d', 'volume_name': 'volume-a25c982d-246b-43ce-884c-8e4a21c7315d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354c34f8-5fd4-4d0d-a74c-e1bb4994732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354c34f8-5fd4-4d0d-a74c-e1bb4994732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a704b8bc-92ef-4a0e-8cc9-8ce425470da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Volume a25c982d-246b-43ce-884c-8e4a21c7315d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a25c982d-246b-43ce-884c-8e4a21c7315d', 'volume_size': 1} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-834495941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a25c982d-246b-43ce-884c-8e4a21c7315d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f78281612d463abddf31fcd5eedca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:26Z,use_quota=True,user_id='f63ea8d815114b659012dde6a3d090f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Creating volume a25c982d-246b-43ce-884c-8e4a21c7315d {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:26 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:26 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d 1073741824 Aug 05 15:45:26 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (4f086140-961b-4aa4-8cab-ddfdad708426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de879cd5-08f0-43b0-962a-e32dfa2da91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de879cd5-08f0-43b0-962a-e32dfa2da91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935581212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6421d02-a66d-4e1b-9e40-629f4cd4af75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:26Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bb54ae-14b1-483f-97dd-2cb3c97bee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bb54ae-14b1-483f-97dd-2cb3c97bee27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba382a7-f1c1-48a3-b60b-8715941df5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba382a7-f1c1-48a3-b60b-8715941df5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6421d02-a66d-4e1b-9e40-629f4cd4af75', 'volume_name': 'volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d006f6c-593e-4e79-8285-9343c76c052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d006f6c-593e-4e79-8285-9343c76c052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc085163-0b7f-45e1-b01f-ae8076aa5a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume b6421d02-a66d-4e1b-9e40-629f4cd4af75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75', 'volume_size': 1} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e" returned: 0 in 0.579s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:26 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e Aug 05 15:45:26 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:26 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-da5af7bf-4213-4375-9daa-f69b3fd99c3e" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Lock "cinder-quobyte-da5af7bf-4213-4375-9daa-f69b3fd99c3e" released by "delete_volume" :: held 0.916s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:26 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d 1073741824" returned: 0 in 0.486s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.quota [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Created reservations ['5aa3e8bf-88da-49a8-8172-0d2fb7bc84f4', '7a756f98-5bdb-40e2-8ee3-e1042eafe78e', '93fce29b-aef7-4c4a-af40-c6556a03d251', '866761cc-06d5-4ccf-8cfb-8f3bfbe7f467'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:26 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d Aug 05 15:45:26 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:26 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:26 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:26 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.755s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a704b8bc-92ef-4a0e-8cc9-8ce425470da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a25c982d-246b-43ce-884c-8e4a21c7315d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36723d5-4bb4-4dd7-8735-7246faeda79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0432a8-9ae5-4f15-958f-2a8e144db894]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Volume volume-a25c982d-246b-43ce-884c-8e4a21c7315d (a25c982d-246b-43ce-884c-8e4a21c7315d): created successfully Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36723d5-4bb4-4dd7-8735-7246faeda79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Flow 'volume_create_manager' (94b51a7d-5c36-411c-b26b-f89f3707d0db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:27 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.manager [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-45c48863-ada6-4ad3-b9f2-700dd7be600c tempest-VolumesTransfersV355Test-1627256519 None] Created volume successfully. Aug 05 15:45:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Deleted volume successfully. Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [req-503b4263-6c24-4ed3-8939-b90240a3a3e7 req-38a6cc20-579e-4bd9-bd3e-a65818f8d566 tempest-TestShelveInstance-1859733100 None] Lock "cinder-da5af7bf-4213-4375-9daa-f69b3fd99c3e-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:27 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da Aug 05 15:45:27 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:27 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da" returned: 0 in 0.396s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a 2G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a 2G" returned: 0 in 0.139s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.578s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.205s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-935581212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6421d02-a66d-4e1b-9e40-629f4cd4af75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:26Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating volume b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:27 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 1073741824 Aug 05 15:45:27 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f251e10e-8b32-448f-ae73-aabdf1c6b6a1 tempest-VolumesExtendTest-122876544 None] Extend volume completed successfully. Aug 05 15:45:28 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 1073741824" returned: 0 in 0.510s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:28 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 Aug 05 15:45:28 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-04070f56-002b-4691-93bb-13571cd6d74a-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Lock "cinder-04070f56-002b-4691-93bb-13571cd6d74a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-quobyte-a840d4e8-47d3-4cc3-81e1-723ce26984da" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-a840d4e8-47d3-4cc3-81e1-723ce26984da" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-quobyte-04070f56-002b-4691-93bb-13571cd6d74a" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-04070f56-002b-4691-93bb-13571cd6d74a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Deleting offline snapshot 04070f56-002b-4691-93bb-13571cd6d74a of volume a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] snapshot_file for this snap is: volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[660cb402-4d34-4370-a934-53c2795e6164]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:28 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75" returned: 0 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc085163-0b7f-45e1-b01f-ae8076aa5a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52580b1c-7061-430b-9ed2-966568c38f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 (b6421d02-a66d-4e1b-9e40-629f4cd4af75): created successfully Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52580b1c-7061-430b-9ed2-966568c38f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (4f086140-961b-4aa4-8cab-ddfdad708426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c337b270-a25f-4bba-b105-72e3cb49ae89 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created volume successfully. Aug 05 15:45:28 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a Aug 05 15:45:28 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f1bb3ad8-218a-40e1-91ab-ce9f1ab94c60 tempest-VolumesTransfersV355Test-308109894 None] Transfer volume completed successfully. Aug 05 15:45:28 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a" returned: 0 in 0.462s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a840d4e8-47d3-4cc3-81e1-723ce26984da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d4ee6-96ce-4eea-82a3-a00dc66228ae]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:29 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da Aug 05 15:45:29 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating offline snapshot 9572474d-ca96-4c2a-8610-7628b3b5bcfb of volume b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ce0768-d9e1-4f0f-b5e4-0f98ab04b3b5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Acquiring lock "cinder-a25c982d-246b-43ce-884c-8e4a21c7315d-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:29 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da" returned: 0 in 0.532s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:29 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 Aug 05 15:45:29 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-a25c982d-246b-43ce-884c-8e4a21c7315d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:29 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a Aug 05 15:45:29 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Acquiring lock "cinder-quobyte-a25c982d-246b-43ce-884c-8e4a21c7315d" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-quobyte-a25c982d-246b-43ce-884c-8e4a21c7315d" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761c25b-2fb0-4a96-9509-01136e374cb5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:29 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d Aug 05 15:45:29 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:29 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75" returned: 0 in 0.394s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:29 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb 1G Aug 05 15:45:29 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a" returned: 0 in 0.466s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:30 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a Aug 05 15:45:30 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d" returned: 0 in 0.468s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:30 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d Aug 05 15:45:30 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da.04070f56-002b-4691-93bb-13571cd6d74a" returned: 0 in 0.284s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb 1G" returned: 0 in 0.509s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-04070f56-002b-4691-93bb-13571cd6d74a" released by "_delete_snapshot" :: held 1.927s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-a840d4e8-47d3-4cc3-81e1-723ce26984da" released by "delete_snapshot" :: held 1.963s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:30 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb Aug 05 15:45:30 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a25c982d-246b-43ce-884c-8e4a21c7315d" returned: 0 in 0.302s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-quobyte-a25c982d-246b-43ce-884c-8e4a21c7315d" released by "delete_volume" :: held 0.828s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Created reservations ['f304d24f-c58f-437e-b269-04ef61854972', 'b2a04686-f332-45d6-b9fb-1c08cba00b78', 'e898597c-ed8e-443d-8f87-3380be3fe846', '05adc1d2-67df-44ac-aa7c-8d888629bc38'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Delete snapshot completed successfully. Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dde2690-d6d9-4ccb-b68c-17580a3c229c tempest-VolumesExtendTest-122876544 None] Lock "cinder-04070f56-002b-4691-93bb-13571cd6d74a-delete_snapshot" released by "delete_snapshot" :: held 2.196s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Created reservations ['462dba52-ba82-4b81-8c54-5db101c54dd7', '1cc76561-548a-49ca-9420-11914a2a076c', '5a5256b1-a1df-45fb-bb12-807477ce2b88', '8c3ddeae-fc66-4e7b-9a7a-18b4107d7ef9'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:30 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:30 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb" returned: 0 in 0.381s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb is being set with open permissions: ugo+rw Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:30 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb Aug 05 15:45:30 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:30 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.283s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:30 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Deleted volume successfully. Aug 05 15:45:31 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-537f0e43-b2e0-43a4-b868-3f826f58422b tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-a25c982d-246b-43ce-884c-8e4a21c7315d-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:31 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info Aug 05 15:45:31 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:31 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:31 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info is being set with open permissions: ugo+rw Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:31 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info Aug 05 15:45:31 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Flow 'volume_create_manager' (ac35d114-8241-4f5c-a0cd-a16143f6c0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b81ddb4-46d3-4880-ac6a-2344aff046a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b81ddb4-46d3-4880-ac6a-2344aff046a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-599940831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b021614d-3a75-4832-8925-cbaefdac221a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f78281612d463abddf31fcd5eedca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:31Z,use_quota=True,user_id='f63ea8d815114b659012dde6a3d090f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c703d06-3467-4b58-a53c-131cfa0e6975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c703d06-3467-4b58-a53c-131cfa0e6975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b266a8d7-ca11-4eae-8c2f-74a0b3058632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b266a8d7-ca11-4eae-8c2f-74a0b3058632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b021614d-3a75-4832-8925-cbaefdac221a', 'volume_name': 'volume-b021614d-3a75-4832-8925-cbaefdac221a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40603f8-63f3-4c76-9063-f81e8ba29ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40603f8-63f3-4c76-9063-f81e8ba29ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe49df7-d2f8-4627-8514-d7a1df1e182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Volume b021614d-3a75-4832-8925-cbaefdac221a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b021614d-3a75-4832-8925-cbaefdac221a', 'volume_size': 1} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:31 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.info" returned: 0 in 0.250s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.261s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-599940831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b021614d-3a75-4832-8925-cbaefdac221a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f78281612d463abddf31fcd5eedca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:31Z,use_quota=True,user_id='f63ea8d815114b659012dde6a3d090f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Creating volume b021614d-3a75-4832-8925-cbaefdac221a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:31 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:31 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a 1073741824 Aug 05 15:45:31 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c0a0b542-cd1e-449b-82de-40cc0446c9fe tempest-CreateVolumesFromSnapshotTest-1296612091 None] Create snapshot completed successfully Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-a840d4e8-47d3-4cc3-81e1-723ce26984da-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Lock "cinder-a840d4e8-47d3-4cc3-81e1-723ce26984da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Acquiring lock "cinder-quobyte-a840d4e8-47d3-4cc3-81e1-723ce26984da" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-a840d4e8-47d3-4cc3-81e1-723ce26984da" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd6dc3f-216d-4a40-b525-d9befdd1b40b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:32 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da Aug 05 15:45:32 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:32 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a 1073741824" returned: 0 in 0.544s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:32 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a Aug 05 15:45:32 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:32 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da" returned: 0 in 0.479s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:32 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da Aug 05 15:45:32 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:32 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe49df7-d2f8-4627-8514-d7a1df1e182b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b021614d-3a75-4832-8925-cbaefdac221a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befac5cb-558a-44ad-9f38-0093e92e301f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Volume volume-b021614d-3a75-4832-8925-cbaefdac221a (b021614d-3a75-4832-8925-cbaefdac221a): created successfully Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befac5cb-558a-44ad-9f38-0093e92e301f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Flow 'volume_create_manager' (ac35d114-8241-4f5c-a0cd-a16143f6c0fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:32 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a840d4e8-47d3-4cc3-81e1-723ce26984da" returned: 0 in 0.338s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Lock "cinder-quobyte-a840d4e8-47d3-4cc3-81e1-723ce26984da" released by "delete_volume" :: held 0.915s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-984561da-0ab7-4f07-8de3-8cf3b3f89983 tempest-VolumesTransfersV355Test-1627256519 None] Created volume successfully. Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Created reservations ['ffc33d1a-5071-418c-9fc1-4359a8d7db02', '32d1235c-9ffa-4f5d-94bd-46ee79678374', '0708ac7f-4689-44dc-94ac-c0eb8e5051dd', '60b7fc9c-dd77-42b3-b5db-bd4da697dab0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:33 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:33 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (5827c36a-b371-4fda-820f-dbac01326247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413cb743-15d9-4d40-818a-787549b09791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (413cb743-15d9-4d40-818a-787549b09791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556013046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace71a8b-e72b-46d3-bc54-765ac9d38f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:33Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f308b9f-ab4d-4d84-838b-a617d71912f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f308b9f-ab4d-4d84-838b-a617d71912f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca81bd8-c809-492d-900e-87dd555bf6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ca81bd8-c809-492d-900e-87dd555bf6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace71a8b-e72b-46d3-bc54-765ac9d38f3d', 'volume_name': 'volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1607c8e8-2adf-4c02-97f0-c19a37200ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1607c8e8-2adf-4c02-97f0-c19a37200ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1b1e7d-4aaf-4545-9fcb-6ba9b408582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume ace71a8b-e72b-46d3-bc54-765ac9d38f3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d', 'volume_size': 1} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-556013046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace71a8b-e72b-46d3-bc54-765ac9d38f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:33Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating volume ace71a8b-e72b-46d3-bc54-765ac9d38f3d {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:33 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:33 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d 1073741824 Aug 05 15:45:33 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:33 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.300s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Deleted volume successfully. Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5205d71d-aeb9-4056-80ac-5fbf27f8db27 tempest-VolumesExtendTest-122876544 None] Lock "cinder-a840d4e8-47d3-4cc3-81e1-723ce26984da-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (abdc4305-4d8c-4ec7-bbdb-6356308d216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55245114-1fca-4ed6-b80e-caf523630700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55245114-1fca-4ed6-b80e-caf523630700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-682564045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a0cf3-9118-4139-a140-386f8720f996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:34Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6012dc66-2f20-4646-ba9e-fb6cc23996e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6012dc66-2f20-4646-ba9e-fb6cc23996e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e45f2c-a419-4bdb-a475-1aaf8b6a87b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e45f2c-a419-4bdb-a475-1aaf8b6a87b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '061a0cf3-9118-4139-a140-386f8720f996', 'volume_name': 'volume-061a0cf3-9118-4139-a140-386f8720f996', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650f9796-6d42-423a-9080-ddad109fea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (650f9796-6d42-423a-9080-ddad109fea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9227800-4585-49ff-8972-7e28f3310a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume 061a0cf3-9118-4139-a140-386f8720f996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-061a0cf3-9118-4139-a140-386f8720f996', 'volume_size': 1} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Acquiring lock "cinder-b021614d-3a75-4832-8925-cbaefdac221a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:33 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d 1073741824" returned: 0 in 0.664s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-b021614d-3a75-4832-8925-cbaefdac221a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Acquiring lock "cinder-quobyte-b021614d-3a75-4832-8925-cbaefdac221a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:34 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d Aug 05 15:45:34 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-quobyte-b021614d-3a75-4832-8925-cbaefdac221a" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[041df7e6-7497-4aa6-bcfc-bf846d603976]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:34 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a Aug 05 15:45:34 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (8029517b-78ca-419e-b387-d72a2c8e704e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ff180b-03dd-481e-a753-09f88ae4cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ff180b-03dd-481e-a753-09f88ae4cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216486567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1ce914-c2bc-461e-b4c7-843f4ede5700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:34Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8649d2-eb35-4e9d-906f-974e749ab92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8649d2-eb35-4e9d-906f-974e749ab92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:34 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e72088-092c-42ed-9926-556c744edf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e72088-092c-42ed-9926-556c744edf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f1ce914-c2bc-461e-b4c7-843f4ede5700', 'volume_name': 'volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b750ee-f6ea-4696-9b30-a2f4b5e93f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b750ee-f6ea-4696-9b30-a2f4b5e93f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823ebea9-bfa7-436d-b375-f6b6f5d80a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume 8f1ce914-c2bc-461e-b4c7-843f4ede5700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700', 'volume_size': 1} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d" returned: 0 in 0.556s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-682564045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=061a0cf3-9118-4139-a140-386f8720f996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:34Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating volume 061a0cf3-9118-4139-a140-386f8720f996 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:34 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1b1e7d-4aaf-4545-9fcb-6ba9b408582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:34 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 1073741824 Aug 05 15:45:34 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80120346-649a-43ef-a869-c671ff044ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d (ace71a8b-e72b-46d3-bc54-765ac9d38f3d): created successfully Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80120346-649a-43ef-a869-c671ff044ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (5827c36a-b371-4fda-820f-dbac01326247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1de03914-b081-4f57-ba65-9538e0176d62 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created volume successfully. Aug 05 15:45:34 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a" returned: 0 in 0.648s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:34 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a Aug 05 15:45:34 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:35 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b021614d-3a75-4832-8925-cbaefdac221a" returned: 0 in 0.480s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-quobyte-b021614d-3a75-4832-8925-cbaefdac221a" released by "delete_volume" :: held 1.212s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (b7f90cec-adda-42c1-9b4a-551a8b8b2e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975d35c4-a454-4364-be45-adecf13a8ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 1073741824" returned: 0 in 0.818s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975d35c4-a454-4364-be45-adecf13a8ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116457917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136c7ab8-4d34-4b5e-bbea-e5abb3095b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:35Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d1619a-d90f-4557-bc98-2eaf7e11fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d1619a-d90f-4557-bc98-2eaf7e11fe73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0047bfe4-a6d4-41ad-ae0d-230e8f9aa1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0047bfe4-a6d4-41ad-ae0d-230e8f9aa1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136c7ab8-4d34-4b5e-bbea-e5abb3095b11', 'volume_name': 'volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723b36a5-5ccd-405d-a270-61878e31045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723b36a5-5ccd-405d-a270-61878e31045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3f9676-b44f-4c03-9b98-d2480247bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume 136c7ab8-4d34-4b5e-bbea-e5abb3095b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11', 'volume_size': 1} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Created reservations ['5ba61563-1a99-45e6-b2b5-c3368697056e', 'c00bf4ef-37c8-47c2-9896-b324f25c6750', 'f5490771-2ce8-48f3-b4cc-da1ed2a3992b', 'e8df60bb-c43f-45cb-abe4-338b27640536'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:35 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 Aug 05 15:45:35 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:35 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:35 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (528e783d-b6c4-4997-9196-bf6a28222a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29794502-819a-4875-9b06-fd20d0abc090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29794502-819a-4875-9b06-fd20d0abc090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122515881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75653b11-91dc-4dbb-a519-52072ba65df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:36Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c54b0ad-aceb-419f-9912-16ba6da69b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c54b0ad-aceb-419f-9912-16ba6da69b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be1c1fb-e074-4503-8fe3-a602b1616375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be1c1fb-e074-4503-8fe3-a602b1616375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75653b11-91dc-4dbb-a519-52072ba65df5', 'volume_name': 'volume-75653b11-91dc-4dbb-a519-52072ba65df5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4028f9f8-da8b-4b37-8843-e102ac515791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4028f9f8-da8b-4b37-8843-e102ac515791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630b441-d231-4b01-9615-67c1be2d2359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume 75653b11-91dc-4dbb-a519-52072ba65df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75653b11-91dc-4dbb-a519-52072ba65df5', 'volume_size': 1} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:35 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996" returned: 0 in 0.420s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1216486567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f1ce914-c2bc-461e-b4c7-843f4ede5700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:34Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating volume 8f1ce914-c2bc-461e-b4c7-843f4ede5700 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:35 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:35 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.317s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:35 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9227800-4585-49ff-8972-7e28f3310a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-061a0cf3-9118-4139-a140-386f8720f996', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:36 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 1073741824 Aug 05 15:45:36 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e710ebb-8908-48c0-a3c2-015ede632330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Deleted volume successfully. Aug 05 15:45:36 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume volume-061a0cf3-9118-4139-a140-386f8720f996 (061a0cf3-9118-4139-a140-386f8720f996): created successfully Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e710ebb-8908-48c0-a3c2-015ede632330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (abdc4305-4d8c-4ec7-bbdb-6356308d216d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-582797ed-6ac2-4f7a-899d-92f1f40572fd tempest-VolumesTransfersV355Test-1117451638 None] Lock "cinder-b021614d-3a75-4832-8925-cbaefdac221a-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b69e2e60-05d9-4454-996c-8fa848bae578 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created volume successfully. Aug 05 15:45:36 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 1073741824" returned: 0 in 0.613s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:36 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 Aug 05 15:45:36 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:36 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700" returned: 0 in 0.299s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-116457917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136c7ab8-4d34-4b5e-bbea-e5abb3095b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:35Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating volume 136c7ab8-4d34-4b5e-bbea-e5abb3095b11 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:36 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823ebea9-bfa7-436d-b375-f6b6f5d80a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304a426f-0563-4359-8178-d4ec836f620b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:37 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 1073741824 Aug 05 15:45:37 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:37 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 (8f1ce914-c2bc-461e-b4c7-843f4ede5700): created successfully Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304a426f-0563-4359-8178-d4ec836f620b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (8029517b-78ca-419e-b387-d72a2c8e704e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-12da5e22-dba7-49ec-abd5-9003d081d013 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created volume successfully. Aug 05 15:45:37 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 1073741824" returned: 0 in 0.610s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:37 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 Aug 05 15:45:37 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:37 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11" returned: 0 in 0.323s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122515881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75653b11-91dc-4dbb-a519-52072ba65df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12d93f0381f8487fbd63cbb59e90629a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:36Z,use_quota=True,user_id='7d55a77d3a9440bc9ca498dca370bd49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Creating volume 75653b11-91dc-4dbb-a519-52072ba65df5 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:37 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3f9676-b44f-4c03-9b98-d2480247bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6ce535-2b27-4927-9f37-0675fa5b0fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 (136c7ab8-4d34-4b5e-bbea-e5abb3095b11): created successfully Aug 05 15:45:38 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 1073741824 Aug 05 15:45:38 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6ce535-2b27-4927-9f37-0675fa5b0fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (b7f90cec-adda-42c1-9b4a-551a8b8b2e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-46f976ba-6d02-4e70-b53d-80660f18754c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created volume successfully. Aug 05 15:45:38 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 1073741824" returned: 0 in 0.711s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:38 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 Aug 05 15:45:38 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (a75c5ba1-a96f-407a-be50-34961862f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf067d0-205f-4be5-9d78-abc514579282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf067d0-205f-4be5-9d78-abc514579282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1987520899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2977a9b-c99e-45f8-9a89-521e5f96b835,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:39Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958b3c68-4a64-4371-8283-2814c0be7802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958b3c68-4a64-4371-8283-2814c0be7802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d86bf-c172-4027-8358-842da5db8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2d86bf-c172-4027-8358-842da5db8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2977a9b-c99e-45f8-9a89-521e5f96b835', 'volume_name': 'volume-f2977a9b-c99e-45f8-9a89-521e5f96b835', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:39 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680134f9-dcbd-40cb-aaa3-07615f769e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (680134f9-dcbd-40cb-aaa3-07615f769e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458ce466-cf87-48f7-aa9b-0213e0c87f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Volume f2977a9b-c99e-45f8-9a89-521e5f96b835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2977a9b-c99e-45f8-9a89-521e5f96b835', 'volume_size': 1} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1987520899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2977a9b-c99e-45f8-9a89-521e5f96b835,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:39Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Creating volume f2977a9b-c99e-45f8-9a89-521e5f96b835 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:39 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4630b441-d231-4b01-9615-67c1be2d2359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75653b11-91dc-4dbb-a519-52072ba65df5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f58432-b2e3-4f8a-91e7-055b573772e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:39 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 1073741824 Aug 05 15:45:39 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Volume volume-75653b11-91dc-4dbb-a519-52072ba65df5 (75653b11-91dc-4dbb-a519-52072ba65df5): created successfully Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f58432-b2e3-4f8a-91e7-055b573772e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Flow 'volume_create_manager' (528e783d-b6c4-4997-9196-bf6a28222a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8f61c5a5-ea9e-488a-9bd3-4fe72bf9dba0 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created volume successfully. Aug 05 15:45:39 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 1073741824" returned: 0 in 0.568s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:39 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 Aug 05 15:45:39 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:39 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835" returned: 0 in 0.301s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (458ce466-cf87-48f7-aa9b-0213e0c87f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2977a9b-c99e-45f8-9a89-521e5f96b835', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de851d94-bec2-4dc4-93dd-5bf748786b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:40 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Volume volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 (f2977a9b-c99e-45f8-9a89-521e5f96b835): created successfully Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de851d94-bec2-4dc4-93dd-5bf748786b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (a75c5ba1-a96f-407a-be50-34961862f75a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:40 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-80da1c28-25ae-48da-a9f7-37d40182bd1d tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-75653b11-91dc-4dbb-a519-52072ba65df5-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-75653b11-91dc-4dbb-a519-52072ba65df5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-75653b11-91dc-4dbb-a519-52072ba65df5" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-75653b11-91dc-4dbb-a519-52072ba65df5" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0b100e-800d-499d-9632-9402485e91df]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:40 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 Aug 05 15:45:40 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:40 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5" returned: 0 in 0.427s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:40 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5 Aug 05 15:45:40 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:41 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-75653b11-91dc-4dbb-a519-52072ba65df5" returned: 0 in 0.390s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-75653b11-91dc-4dbb-a519-52072ba65df5" released by "delete_volume" :: held 0.891s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['b59117c8-9cc1-4f8b-9231-e537bdf08822', '4b63f93a-c196-4985-85d6-b458251a3b9a', '7c421a4b-539a-493f-a2a7-4d6b322b830e', '8e03a995-8c69-43e4-b3da-0085a274fd72'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:41 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:41 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:41 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.343s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleted volume successfully. Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-26ff784b-f4ce-4034-bc4b-fe8b09a334c8 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-75653b11-91dc-4dbb-a519-52072ba65df5-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:41 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (49c07a29-ff52-429c-9608-0f932a1fdf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fb0786-7e86-434a-869d-6e18c2d26e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fb0786-7e86-434a-869d-6e18c2d26e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2036966394',display_name='tempest-VolumesGetTest-Volume-37588905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0652314-d430-4310-8c4c-513269b434cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:42Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036f6cb2-1e65-4dec-9f84-84fec4fdf960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036f6cb2-1e65-4dec-9f84-84fec4fdf960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e94b324-8e93-4e51-a09d-09877c80dd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e94b324-8e93-4e51-a09d-09877c80dd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0652314-d430-4310-8c4c-513269b434cd', 'volume_name': 'volume-b0652314-d430-4310-8c4c-513269b434cd', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c19fe2-a3cd-486a-9555-21fe9b30d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c19fe2-a3cd-486a-9555-21fe9b30d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8898f3-6f46-4372-bd26-c88953bc611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:42 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Volume b0652314-d430-4310-8c4c-513269b434cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0652314-d430-4310-8c4c-513269b434cd', 'volume_size': 1} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2036966394',display_name='tempest-VolumesGetTest-Volume-37588905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0652314-d430-4310-8c4c-513269b434cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:42Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Creating volume b0652314-d430-4310-8c4c-513269b434cd {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:42 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:42 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd 1073741824 Aug 05 15:45:42 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:42 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd 1073741824" returned: 0 in 0.495s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-136c7ab8-4d34-4b5e-bbea-e5abb3095b11-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-136c7ab8-4d34-4b5e-bbea-e5abb3095b11-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:42 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd Aug 05 15:45:42 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-136c7ab8-4d34-4b5e-bbea-e5abb3095b11" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-136c7ab8-4d34-4b5e-bbea-e5abb3095b11" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada57d53-d863-47d4-b905-e8eb04c8f2c4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:42 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 Aug 05 15:45:42 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:43 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f8898f3-6f46-4372-bd26-c88953bc611a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0652314-d430-4310-8c4c-513269b434cd', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33efe888-44a9-4b2d-af56-c39550a37bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:43 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Volume volume-b0652314-d430-4310-8c4c-513269b434cd (b0652314-d430-4310-8c4c-513269b434cd): created successfully Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33efe888-44a9-4b2d-af56-c39550a37bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (49c07a29-ff52-429c-9608-0f932a1fdf71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:43 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e3709c9e-372a-469b-81a8-6c2effbf88b8 tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:45:43 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11" returned: 0 in 0.473s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:43 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11 Aug 05 15:45:43 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:43 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-136c7ab8-4d34-4b5e-bbea-e5abb3095b11" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-136c7ab8-4d34-4b5e-bbea-e5abb3095b11" released by "delete_volume" :: held 0.803s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['2d79e753-2ad8-45a3-b76f-15c962a7af4e', 'a878b2a8-4f27-48f7-96c4-abe9db007451', '6d3791a8-462f-44a0-980e-16fa3c5e01ed', '96bd8e8f-f852-4ea6-900f-dd7fa021f1a8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:43 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:43 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-8f1ce914-c2bc-461e-b4c7-843f4ede5700-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-8f1ce914-c2bc-461e-b4c7-843f4ede5700-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-8f1ce914-c2bc-461e-b4c7-843f4ede5700" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-8f1ce914-c2bc-461e-b4c7-843f4ede5700" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84e166-7017-4f0c-8445-16eef071f7ee]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:44 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleted volume successfully. Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2f2216f2-0ce5-495c-846f-c56a76612135 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-136c7ab8-4d34-4b5e-bbea-e5abb3095b11-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:44 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 Aug 05 15:45:44 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-b0652314-d430-4310-8c4c-513269b434cd-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Lock "cinder-b0652314-d430-4310-8c4c-513269b434cd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-b0652314-d430-4310-8c4c-513269b434cd" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-b0652314-d430-4310-8c4c-513269b434cd" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[72db8083-c5e2-414e-98da-464fb3d3e31a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:44 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700" returned: 0 in 0.546s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:44 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd Aug 05 15:45:44 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:44 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700 Aug 05 15:45:44 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:44 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8f1ce914-c2bc-461e-b4c7-843f4ede5700" returned: 0 in 0.307s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-8f1ce914-c2bc-461e-b4c7-843f4ede5700" released by "delete_volume" :: held 0.929s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:44 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd" returned: 0 in 0.468s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:44 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd Aug 05 15:45:44 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:44 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['9be313c9-6791-4a80-9559-b6ece9d288cc', '45c2c8a8-a12f-4bf3-852e-3db101c058c9', 'e8a0d679-9558-4b55-abbf-a3e735a73c99', 'f5eec7b0-2e3d-4e7b-9971-880d6ec096d4'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:45 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:45 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:45 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b0652314-d430-4310-8c4c-513269b434cd" returned: 0 in 0.319s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-b0652314-d430-4310-8c4c-513269b434cd" released by "delete_volume" :: held 0.853s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Created reservations ['e6849e60-9cd0-4b4b-8e50-1e0d182a78c8', '0132cea2-2851-4af7-9d97-879112728fb0', 'b811d199-ec00-466d-bd02-65e43751d856', 'f067c55e-d925-4a5e-b5ae-924184a28ec9'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Flow 'volume_create_manager' (a4692586-cf93-4bc1-b8fa-7eb413aded19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c134c60-5136-4a0e-85af-4ba0df37b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:45 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c134c60-5136-4a0e-85af-4ba0df37b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1089272513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a023cb-aaa5-4179-ab8b-74cc36157215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2300e5fb154b6b8345c34d0e754ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:45Z,use_quota=True,user_id='c65fb42f156c436d9d7db0b58374f832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbfa467-4009-4517-9d5e-aef36c606095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbfa467-4009-4517-9d5e-aef36c606095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0677a4bf-0d10-4b11-a05d-c1605b0ddd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0677a4bf-0d10-4b11-a05d-c1605b0ddd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a023cb-aaa5-4179-ab8b-74cc36157215', 'volume_name': 'volume-b5a023cb-aaa5-4179-ab8b-74cc36157215', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c9e41e-de60-4844-acc9-1e1090ff35af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c9e41e-de60-4844-acc9-1e1090ff35af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d50df7-8d1d-4ba7-894c-2ed590e020b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:45 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Volume b5a023cb-aaa5-4179-ab8b-74cc36157215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a023cb-aaa5-4179-ab8b-74cc36157215', 'volume_size': 1} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1089272513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a023cb-aaa5-4179-ab8b-74cc36157215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2300e5fb154b6b8345c34d0e754ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:45Z,use_quota=True,user_id='c65fb42f156c436d9d7db0b58374f832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Creating volume b5a023cb-aaa5-4179-ab8b-74cc36157215 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:45 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.535s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:45 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 1073741824 Aug 05 15:45:45 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleted volume successfully. Aug 05 15:45:45 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:45 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b27eedb4-3472-4e1a-9688-2cb313a0af8c tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-8f1ce914-c2bc-461e-b4c7-843f4ede5700-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:45 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.264s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:45:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5a3489d3-8e66-4622-b998-9cd3d143560e tempest-VolumesGetTest-1525546891 None] Lock "cinder-b0652314-d430-4310-8c4c-513269b434cd-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:46 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 1073741824" returned: 0 in 0.586s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-061a0cf3-9118-4139-a140-386f8720f996-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-061a0cf3-9118-4139-a140-386f8720f996-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:46 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 Aug 05 15:45:46 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-061a0cf3-9118-4139-a140-386f8720f996" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-061a0cf3-9118-4139-a140-386f8720f996" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2716d8d-2111-4c9f-a162-19ee74a17113]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:46 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 Aug 05 15:45:46 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:46 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215" returned: 0 in 0.313s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d50df7-8d1d-4ba7-894c-2ed590e020b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a023cb-aaa5-4179-ab8b-74cc36157215', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389b9c89-388f-4cb7-9aa8-bc258f26a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:46 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Volume volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 (b5a023cb-aaa5-4179-ab8b-74cc36157215): created successfully Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389b9c89-388f-4cb7-9aa8-bc258f26a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Flow 'volume_create_manager' (a4692586-cf93-4bc1-b8fa-7eb413aded19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-f2977a9b-c99e-45f8-9a89-521e5f96b835-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:46 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-235cd9ff-bda0-4a58-82ce-f2dd4f260eca tempest-VolumesTransfersV357Test-537882520 None] Created volume successfully. Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Lock "cinder-f2977a9b-c99e-45f8-9a89-521e5f96b835-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-f2977a9b-c99e-45f8-9a89-521e5f96b835" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-f2977a9b-c99e-45f8-9a89-521e5f96b835" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:46 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996" returned: 0 in 0.470s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81b04e-cc9c-4bc5-93a8-116b6f2ab11f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:46 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996 Aug 05 15:45:46 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:47 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 Aug 05 15:45:47 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:47 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-061a0cf3-9118-4139-a140-386f8720f996" returned: 0 in 0.282s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-061a0cf3-9118-4139-a140-386f8720f996" released by "delete_volume" :: held 0.807s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['85184652-a290-4367-aa89-760f243bb9ba', '3be6f903-ea4e-41ab-a830-14f445ecad22', 'dc4e4d45-5fd6-4a2e-bf56-b7105101c63a', 'e34c014b-13a1-4671-9d47-ab1316c2009d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:47 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835" returned: 0 in 0.448s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:47 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835 Aug 05 15:45:47 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:47 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:47 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-ace71a8b-e72b-46d3-bc54-765ac9d38f3d-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-ace71a8b-e72b-46d3-bc54-765ac9d38f3d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-ace71a8b-e72b-46d3-bc54-765ac9d38f3d" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-ace71a8b-e72b-46d3-bc54-765ac9d38f3d" acquired by "delete_volume" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e18a4ed-30b7-4a17-91bc-94a742917be8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:47 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2977a9b-c99e-45f8-9a89-521e5f96b835" returned: 0 in 0.441s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-f2977a9b-c99e-45f8-9a89-521e5f96b835" released by "delete_volume" :: held 0.961s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:47 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.418s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleted volume successfully. Aug 05 15:45:47 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d Aug 05 15:45:47 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-059a24e3-7e8f-4add-9a67-9daed9d46025 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-061a0cf3-9118-4139-a140-386f8720f996-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Created reservations ['d4de907b-d574-44cf-b7f1-82c27c868a05', 'deaf7aa4-34be-46b0-9618-930b742c8c4f', '4ab5ffe8-42a1-4223-bff5-c9ff17c41f21', '6d1b76eb-70b3-46fa-af86-bab553c0d6f2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:48 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:48 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:48 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d" returned: 0 in 0.540s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:48 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d Aug 05 15:45:48 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:48 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-09c82c6f-c394-4071-a3fa-9df7499bf868 tempest-VolumesGetTest-1525546891 None] Lock "cinder-f2977a9b-c99e-45f8-9a89-521e5f96b835-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-16aec62a-c55e-4b40-afa2-5800fea5589a tempest-VolumesTransfersV357Test-598018937 None] Transfer volume completed successfully. Aug 05 15:45:48 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ace71a8b-e72b-46d3-bc54-765ac9d38f3d" returned: 0 in 0.366s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-ace71a8b-e72b-46d3-bc54-765ac9d38f3d" released by "delete_volume" :: held 0.973s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['ea055737-8726-4dff-8864-c5ba89f93711', '51c337ee-d685-4720-8a2b-a2af45e8bd2d', '17bb64b0-9f20-4369-ba2e-9f6e77826b82', 'ef9820cc-7a0e-484e-98bc-6e841432b010'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:48 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:48 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:49 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleted volume successfully. Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Acquiring lock "cinder-b5a023cb-aaa5-4179-ab8b-74cc36157215-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ed25a6c0-f8d4-45df-b1aa-cf274a05d7db tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-ace71a8b-e72b-46d3-bc54-765ac9d38f3d-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-b5a023cb-aaa5-4179-ab8b-74cc36157215-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Acquiring lock "cinder-quobyte-b5a023cb-aaa5-4179-ab8b-74cc36157215" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-quobyte-b5a023cb-aaa5-4179-ab8b-74cc36157215" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4477428a-a468-4c18-8308-bd25d0941f5b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:49 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 Aug 05 15:45:49 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:49 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (d439fa58-9c2d-4917-854e-bd63a9baf04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd634aa3-8f33-4fd7-b426-9c3dd803b89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215" returned: 0 in 0.678s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-9572474d-ca96-4c2a-8610-7628b3b5bcfb-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:49 devstack sudo[102937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215 Aug 05 15:45:49 devstack sudo[102937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd634aa3-8f33-4fd7-b426-9c3dd803b89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1502539085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01c19c4-d8d1-4448-812b-17a7aae599a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:50Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976deeb7-31f6-4468-8d39-40b5023dc372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976deeb7-31f6-4468-8d39-40b5023dc372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af59b0a1-5787-4a02-b5ca-a02b886f59ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af59b0a1-5787-4a02-b5ca-a02b886f59ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f01c19c4-d8d1-4448-812b-17a7aae599a2', 'volume_name': 'volume-f01c19c4-d8d1-4448-812b-17a7aae599a2', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9388b982-9549-4d0b-99e2-6c85d3c1f933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9388b982-9549-4d0b-99e2-6c85d3c1f933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5deb55f4-ac65-450f-a29a-9a3b7ef4a344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:49 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Volume f01c19c4-d8d1-4448-812b-17a7aae599a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f01c19c4-d8d1-4448-812b-17a7aae599a2', 'volume_size': 1} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1502539085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f01c19c4-d8d1-4448-812b-17a7aae599a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:50Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Creating volume f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:49 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-9572474d-ca96-4c2a-8610-7628b3b5bcfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.111s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-b6421d02-a66d-4e1b-9e40-629f4cd4af75" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:50 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 1073741824 Aug 05 15:45:50 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-b6421d02-a66d-4e1b-9e40-629f4cd4af75" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-9572474d-ca96-4c2a-8610-7628b3b5bcfb" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-9572474d-ca96-4c2a-8610-7628b3b5bcfb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleting offline snapshot 9572474d-ca96-4c2a-8610-7628b3b5bcfb of volume b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] snapshot_file for this snap is: volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d2918b-8c5e-46ba-8fec-1b6e3ba4ecd8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:50 devstack sudo[102937]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b5a023cb-aaa5-4179-ab8b-74cc36157215" returned: 0 in 0.440s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-quobyte-b5a023cb-aaa5-4179-ab8b-74cc36157215" released by "delete_volume" :: held 1.168s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:50 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb Aug 05 15:45:50 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Created reservations ['20334746-b9bb-42bd-ba4c-12ccf1464459', 'efc00bc5-2e45-4da8-8dc8-25ede437317a', '83685d33-984b-4e77-a2f7-7427164c7681', 'c7ba732b-5b31-4853-ac27-ad1081b32103'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:50 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:50 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:50 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 1073741824" returned: 0 in 0.678s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:50 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:50 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 Aug 05 15:45:50 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb" returned: 0 in 0.645s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4ed8b9-76e3-45db-b325-c1e2272370b6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:50 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.323s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:50 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Deleted volume successfully. Aug 05 15:45:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa252bba-94f2-45fc-bc6b-3f71fe766626 tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-b5a023cb-aaa5-4179-ab8b-74cc36157215-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:50 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 Aug 05 15:45:50 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:51 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2" returned: 0 in 0.329s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5deb55f4-ac65-450f-a29a-9a3b7ef4a344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f01c19c4-d8d1-4448-812b-17a7aae599a2', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c2e55d-4755-417e-ac57-b420bafd98cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:51 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Volume volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 (f01c19c4-d8d1-4448-812b-17a7aae599a2): created successfully Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c2e55d-4755-417e-ac57-b420bafd98cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (d439fa58-9c2d-4917-854e-bd63a9baf04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c346ba5c-c89b-4a08-9a89-76e4659095be tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:45:51 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75" returned: 0 in 0.419s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:51 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb Aug 05 15:45:51 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:51 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:51 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb Aug 05 15:45:51 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:52 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75.9572474d-ca96-4c2a-8610-7628b3b5bcfb" returned: 0 in 0.461s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Flow 'volume_create_manager' (9bdf5bf8-2e34-43ab-9b0c-ad47b2ef638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9a6f92-6a50-42c0-81f8-0c997bd595db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-9572474d-ca96-4c2a-8610-7628b3b5bcfb" released by "_delete_snapshot" :: held 2.106s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-b6421d02-a66d-4e1b-9e40-629f4cd4af75" released by "delete_snapshot" :: held 2.145s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b9a6f92-6a50-42c0-81f8-0c997bd595db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-280297462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbb038f-6e8e-431d-8b21-b32d189f1adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2300e5fb154b6b8345c34d0e754ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:52Z,use_quota=True,user_id='c65fb42f156c436d9d7db0b58374f832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b3b84e-f4d2-4277-a418-e55fb2f979e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b3b84e-f4d2-4277-a418-e55fb2f979e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5654b9-04de-43e3-b530-6f2eca53e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5654b9-04de-43e3-b530-6f2eca53e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdbb038f-6e8e-431d-8b21-b32d189f1adb', 'volume_name': 'volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27e1041-78e7-4e53-b95e-7c804989b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27e1041-78e7-4e53-b95e-7c804989b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d159730-7130-4d35-9028-e78dd98e2d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Volume fdbb038f-6e8e-431d-8b21-b32d189f1adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb', 'volume_size': 1} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-280297462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbb038f-6e8e-431d-8b21-b32d189f1adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de2300e5fb154b6b8345c34d0e754ffe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:52Z,use_quota=True,user_id='c65fb42f156c436d9d7db0b58374f832',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Creating volume fdbb038f-6e8e-431d-8b21-b32d189f1adb {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:45:52 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:52 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb 1073741824 Aug 05 15:45:52 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['fa561b4d-2a2e-43cf-bd3c-498acb4518f3', '3a0b334a-745b-491d-977c-607b03c5cc78', '3b6f0dd5-56ed-4a47-994b-2e86bdfde112', 'a41f2112-45d3-4344-9e27-1ed31460cbdc'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Delete snapshot completed successfully. Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90cf2888-2ca1-4a32-917b-4589043ce302 tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-9572474d-ca96-4c2a-8610-7628b3b5bcfb-delete_snapshot" released by "delete_snapshot" :: held 2.451s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (e6506cc9-52aa-46bd-bb4e-31c80adcac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6852e92c-dfb7-4fb9-94ac-dfafe8a7e4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6852e92c-dfb7-4fb9-94ac-dfafe8a7e4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1883067325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db55914b-14c7-4a64-8f85-5c3159b26080,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f01c19c4-d8d1-4448-812b-17a7aae599a2,status='creating',terminated_at=None,updated_at=2026-08-05T13:45:53Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc084e26-6954-43fc-a547-50e6ca880bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc084e26-6954-43fc-a547-50e6ca880bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d5daa1-c5f0-4606-afd8-9a660f0421ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9d5daa1-c5f0-4606-afd8-9a660f0421ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'db55914b-14c7-4a64-8f85-5c3159b26080', 'volume_name': 'volume-db55914b-14c7-4a64-8f85-5c3159b26080', 'volume_size': 1, 'source_volid': 'f01c19c4-d8d1-4448-812b-17a7aae599a2', 'source_volstatus': 'available'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff33b3d-5272-4339-afe0-92fe61ce151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aff33b3d-5272-4339-afe0-92fe61ce151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067ef3c4-3535-479f-972b-9b0f21661c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:52 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Volume db55914b-14c7-4a64-8f85-5c3159b26080: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-db55914b-14c7-4a64-8f85-5c3159b26080', 'volume_size': 1, 'source_volid': 'f01c19c4-d8d1-4448-812b-17a7aae599a2', 'source_volstatus': 'available'} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:52 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb 1073741824" returned: 0 in 0.533s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:52 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb Aug 05 15:45:52 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:53 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb" returned: 0 in 0.260s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.390s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:53 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Cloning volume f01c19c4-d8d1-4448-812b-17a7aae599a2 to volume db55914b-14c7-4a64-8f85-5c3159b26080 Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d159730-7130-4d35-9028-e78dd98e2d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a925ae-537e-4628-8a04-f78b376db275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:45:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Volume volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb (fdbb038f-6e8e-431d-8b21-b32d189f1adb): created successfully Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a925ae-537e-4628-8a04-f78b376db275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Flow 'volume_create_manager' (9bdf5bf8-2e34-43ab-9b0c-ad47b2ef638a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Creating offline snapshot e5820511-4d7b-4876-9594-f219cc97c342 of volume f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:45:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-126c2873-e420-455c-9863-be2c4b5c24df tempest-VolumesTransfersV357Test-537882520 None] Created volume successfully. Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-b6421d02-a66d-4e1b-9e40-629f4cd4af75-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba33e41-9f51-454c-b241-55d3079f8250]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-b6421d02-a66d-4e1b-9e40-629f4cd4af75-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "cinder-quobyte-b6421d02-a66d-4e1b-9e40-629f4cd4af75" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-b6421d02-a66d-4e1b-9e40-629f4cd4af75" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1150271c-ad95-4c6c-814e-420bd07cc912]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:53 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 Aug 05 15:45:53 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:53 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 Aug 05 15:45:53 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:53 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2" returned: 0 in 0.446s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:53 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 1G Aug 05 15:45:53 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:53 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75" returned: 0 in 0.388s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:53 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75 Aug 05 15:45:53 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:54 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b6421d02-a66d-4e1b-9e40-629f4cd4af75" returned: 0 in 0.300s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-quobyte-b6421d02-a66d-4e1b-9e40-629f4cd4af75" released by "delete_volume" :: held 0.782s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Created reservations ['adeeb42f-2d47-4613-ab42-509f8295757e', '4597af56-bad5-4b7c-a4dc-a660935d6e87', '08a3b437-6c53-4619-bdcd-13d5a676b454', '9d8537ce-9ee4-4837-9ac6-5c1df014a1d8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:54 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:54 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:54 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 1G" returned: 0 in 0.633s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:54 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 Aug 05 15:45:54 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:54 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.267s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Deleted volume successfully. Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Acquiring lock "cinder-fdbb038f-6e8e-431d-8b21-b32d189f1adb-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-652202df-f783-4a31-9ed9-a6fdc25101ed tempest-CreateVolumesFromSnapshotTest-1296612091 None] Lock "cinder-b6421d02-a66d-4e1b-9e40-629f4cd4af75-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-fdbb038f-6e8e-431d-8b21-b32d189f1adb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Acquiring lock "cinder-quobyte-fdbb038f-6e8e-431d-8b21-b32d189f1adb" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-quobyte-fdbb038f-6e8e-431d-8b21-b32d189f1adb" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fca756-f9fc-4354-845d-c49df7c41889]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:54 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342" returned: 0 in 0.466s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:54 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 is being set with open permissions: ugo+rw Aug 05 15:45:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:54 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 Aug 05 15:45:54 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:54 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb Aug 05 15:45:54 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:55 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:55 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info Aug 05 15:45:55 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:55 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb" returned: 0 in 0.660s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:55 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb Aug 05 15:45:55 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:55 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:55 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info is being set with open permissions: ugo+rw Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:55 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info Aug 05 15:45:55 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:55 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.info" returned: 0 in 0.350s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-db55914b-14c7-4a64-8f85-5c3159b26080" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-db55914b-14c7-4a64-8f85-5c3159b26080" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] snapshot: e5820511-4d7b-4876-9594-f219cc97c342, volume: db55914b-14c7-4a64-8f85-5c3159b26080, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:45:55 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fdbb038f-6e8e-431d-8b21-b32d189f1adb" returned: 0 in 0.575s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-quobyte-fdbb038f-6e8e-431d-8b21-b32d189f1adb" released by "delete_volume" :: held 1.284s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8648e1c3-07b5-4015-abed-d287f28bea70]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Created reservations ['155e2346-7221-4ddc-be62-c5e952010019', 'e750ee71-189e-4a88-898a-72a7d9106ac1', 'c3268a86-3c0d-4b2a-aaf1-8767d10dfd9b', '3d2533a6-f9b6-4494-a35a-ba47b8225ac8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:45:56 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 Aug 05 15:45:56 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:56 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:45:56 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:56 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342" returned: 0 in 0.512s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f01c19c4-d8d1-4448-812b-17a7aae599a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d51b3-0652-444e-abda-f1a73a3f8857]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:56 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.369s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:45:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Deleted volume successfully. Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3e75d97c-b279-472f-954f-bb96d98c126c tempest-VolumesTransfersV357Test-1153158436 None] Lock "cinder-fdbb038f-6e8e-431d-8b21-b32d189f1adb-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:45:56 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 Aug 05 15:45:56 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:45:56 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2" returned: 0 in 0.460s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:45:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:45:57 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 Aug 05 15:45:57 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:02 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080" returned: 0 in 5.610s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:46:02 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Converted 1024.00 MB image at 182.48 MB/s Aug 05 15:46:02 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 is being set with open permissions: ugo+rw Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:02 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 Aug 05 15:46:02 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:02 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-db55914b-14c7-4a64-8f85-5c3159b26080" released by "_copy_volume_from_snapshot" :: held 6.971s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-e5820511-4d7b-4876-9594-f219cc97c342" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-e5820511-4d7b-4876-9594-f219cc97c342" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Deleting offline snapshot e5820511-4d7b-4876-9594-f219cc97c342 of volume f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] snapshot_file for this snap is: volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4996850-34bb-4429-8352-951ed64cfa1a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:03 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 Aug 05 15:46:03 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:03 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342" returned: 0 in 0.403s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f01c19c4-d8d1-4448-812b-17a7aae599a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:46:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[663de50f-2e18-4398-ad92-12d77442cda4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:03 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 Aug 05 15:46:03 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:04 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2" returned: 0 in 0.662s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:04 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 Aug 05 15:46:04 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:04 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:04 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342 Aug 05 15:46:04 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:04 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2.e5820511-4d7b-4876-9594-f219cc97c342" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-e5820511-4d7b-4876-9594-f219cc97c342" released by "_delete_snapshot" :: held 1.864s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.726s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (067ef3c4-3535-479f-972b-9b0f21661c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db55914b-14c7-4a64-8f85-5c3159b26080', 'volume_size': 1, 'source_volid': 'f01c19c4-d8d1-4448-812b-17a7aae599a2', 'source_volstatus': 'available'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d469972-5008-4f8e-a097-35a3c1d4e3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:04 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Volume volume-db55914b-14c7-4a64-8f85-5c3159b26080 (db55914b-14c7-4a64-8f85-5c3159b26080): created successfully Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d469972-5008-4f8e-a097-35a3c1d4e3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (e6506cc9-52aa-46bd-bb4e-31c80adcac5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3df7acd3-6b07-4f87-82c6-be8e0d1c1a67 tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (6c4bf609-4066-4885-8c6e-3d0fc408127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f21baa-b5c5-434d-8d3e-37e49519259e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4f21baa-b5c5-434d-8d3e-37e49519259e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1980330414',display_name='tempest-VolumesGetTest-Volume-294010759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dda299-147a-4729-8768-d7159ffbfcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:07Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e6cf7b-550b-4672-a636-e8ed3cf3e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e6cf7b-550b-4672-a636-e8ed3cf3e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de373c82-011c-4e54-8766-c2ea8abb95fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de373c82-011c-4e54-8766-c2ea8abb95fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25dda299-147a-4729-8768-d7159ffbfcc6', 'volume_name': 'volume-25dda299-147a-4729-8768-d7159ffbfcc6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53ce34f-da5a-4cd6-b113-fe5259e1b60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53ce34f-da5a-4cd6-b113-fe5259e1b60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31563ae2-ae34-4ba6-867d-833e6036c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Volume 25dda299-147a-4729-8768-d7159ffbfcc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25dda299-147a-4729-8768-d7159ffbfcc6', 'volume_size': 1} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1980330414',display_name='tempest-VolumesGetTest-Volume-294010759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25dda299-147a-4729-8768-d7159ffbfcc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:07Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Creating volume 25dda299-147a-4729-8768-d7159ffbfcc6 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:06 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:06 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 1073741824 Aug 05 15:46:06 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:07 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 1073741824" returned: 0 in 0.592s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:07 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 Aug 05 15:46:07 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:07 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31563ae2-ae34-4ba6-867d-833e6036c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25dda299-147a-4729-8768-d7159ffbfcc6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c355f04d-29b0-4505-8097-ec83df707d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Volume volume-25dda299-147a-4729-8768-d7159ffbfcc6 (25dda299-147a-4729-8768-d7159ffbfcc6): created successfully Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c355f04d-29b0-4505-8097-ec83df707d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (6c4bf609-4066-4885-8c6e-3d0fc408127c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:08 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5510fef1-6a51-4ff0-9ea8-828f8a834350 tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:46:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-25dda299-147a-4729-8768-d7159ffbfcc6-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:08 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Lock "cinder-25dda299-147a-4729-8768-d7159ffbfcc6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-25dda299-147a-4729-8768-d7159ffbfcc6" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-25dda299-147a-4729-8768-d7159ffbfcc6" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[71be949f-0709-42fe-95e9-cfed57ce9e3c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:09 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 Aug 05 15:46:09 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (41038591-e79d-4427-b37a-22f8406eec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa71276-5c2c-4ebe-8468-823f07faa799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa71276-5c2c-4ebe-8468-823f07faa799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-336420120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a334b674-3962-43fa-806b-f1eb4f96f09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:09Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70af64b7-eedf-4937-b16f-403b08919124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70af64b7-eedf-4937-b16f-403b08919124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b180599-7b76-46c1-bba2-95ec4c77a281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b180599-7b76-46c1-bba2-95ec4c77a281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a334b674-3962-43fa-806b-f1eb4f96f09a', 'volume_name': 'volume-a334b674-3962-43fa-806b-f1eb4f96f09a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f344e5-4ea6-48f9-94ca-6412e83cb9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f344e5-4ea6-48f9-94ca-6412e83cb9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade810f5-d761-4e7c-9196-71433a6e091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Volume a334b674-3962-43fa-806b-f1eb4f96f09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a334b674-3962-43fa-806b-f1eb4f96f09a', 'volume_size': 1} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-336420120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a334b674-3962-43fa-806b-f1eb4f96f09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:09Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Creating volume a334b674-3962-43fa-806b-f1eb4f96f09a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:09 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:09 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6" returned: 0 in 0.544s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:09 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a 1073741824 Aug 05 15:46:09 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:09 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6 Aug 05 15:46:09 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (6121f3f9-f0fb-4add-89ca-891b5fdcf204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94b0bb-304a-4394-9716-50c8d91a5d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c94b0bb-304a-4394-9716-50c8d91a5d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66508214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfb37a7-8ff0-4d19-8798-465aadbfee50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:10Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7146fe1-e24e-48b3-ad9a-598796475b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7146fe1-e24e-48b3-ad9a-598796475b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc921a2-0235-446b-a8ce-2d547ff020c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc921a2-0235-446b-a8ce-2d547ff020c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acfb37a7-8ff0-4d19-8798-465aadbfee50', 'volume_name': 'volume-acfb37a7-8ff0-4d19-8798-465aadbfee50', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fe3dfc-d6a4-4c5c-a105-227083075952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29fe3dfc-d6a4-4c5c-a105-227083075952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2bc2a2-93ce-4953-bd5b-f80c628141a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:09 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Volume acfb37a7-8ff0-4d19-8798-465aadbfee50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acfb37a7-8ff0-4d19-8798-465aadbfee50', 'volume_size': 1} Aug 05 15:46:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:10 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-25dda299-147a-4729-8768-d7159ffbfcc6" returned: 0 in 0.448s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-25dda299-147a-4729-8768-d7159ffbfcc6" released by "delete_volume" :: held 1.052s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:10 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:10 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Created reservations ['37c10dee-848f-4d38-b156-ba98ddd03d34', '9b062ade-a7b2-4a91-8e6c-d91eb1d2d443', '1e43ba45-fa69-47f5-b752-8a4832e11b2a', '65cc33cc-56b7-4023-bba5-bd85182f9ec7'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:10 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a 1073741824" returned: 0 in 0.852s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:10 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:10 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (db7fcb44-7734-4255-ae0a-7d8e2fbff855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c486e47-41f7-47d5-8574-6283783af278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:10 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=243,cinder:SELECT=162,cinder:INSERT=54,cinder:DELETE=22 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.452s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:10 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a Aug 05 15:46:10 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c486e47-41f7-47d5-8574-6283783af278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408720437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:10Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39f1ac5-8c93-42be-bd83-ed769b8cba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39f1ac5-8c93-42be-bd83-ed769b8cba89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe73389d-615b-42fa-b8c1-3e9385376657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe73389d-615b-42fa-b8c1-3e9385376657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613', 'volume_name': 'volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6728ff76-fb27-4a8d-a479-4c36e59e124a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6728ff76-fb27-4a8d-a479-4c36e59e124a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02ca597-3e17-44cf-aaf7-d571e6a886aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Volume 3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613', 'volume_size': 1} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:46:10 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a" returned: 0 in 0.334s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-66508214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acfb37a7-8ff0-4d19-8798-465aadbfee50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:10Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Creating volume acfb37a7-8ff0-4d19-8798-465aadbfee50 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:10 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ade810f5-d761-4e7c-9196-71433a6e091e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a334b674-3962-43fa-806b-f1eb4f96f09a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a4f6ca-a5c6-4d7d-9f65-fb27e56c7178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:11 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 1073741824 Aug 05 15:46:11 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:11 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.639s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:46:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Volume volume-a334b674-3962-43fa-806b-f1eb4f96f09a (a334b674-3962-43fa-806b-f1eb4f96f09a): created successfully Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69a4f6ca-a5c6-4d7d-9f65-fb27e56c7178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (41038591-e79d-4427-b37a-22f8406eec59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e0785a22-f963-4672-ba49-e36225f21c46 tempest-CreateVolumesFromImageTest-2045362674 None] Created volume successfully. Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e36004e-c2ba-4d68-9df5-885bfb8e2672 tempest-VolumesGetTest-1525546891 None] Lock "cinder-25dda299-147a-4729-8768-d7159ffbfcc6-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (73dec19b-7b36-429d-bbe6-c939d3a86442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814245ea-6aab-42cd-b403-7393c351ccaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (814245ea-6aab-42cd-b403-7393c351ccaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301296738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0ed363-bbfa-4d35-b59c-bf67f8c0634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:11Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c24dcf8-3d6e-4190-8130-54e5b7c5400a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c24dcf8-3d6e-4190-8130-54e5b7c5400a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b440a0-80ec-4885-95df-0ae1eabf9e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b440a0-80ec-4885-95df-0ae1eabf9e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d0ed363-bbfa-4d35-b59c-bf67f8c0634a', 'volume_name': 'volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7946d456-3afe-4af9-9067-a0a77a17efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7946d456-3afe-4af9-9067-a0a77a17efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c053bd3-d3c2-4955-89c4-fbb970c78585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Volume 6d0ed363-bbfa-4d35-b59c-bf67f8c0634a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a', 'volume_size': 1} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-db55914b-14c7-4a64-8f85-5c3159b26080-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Lock "cinder-db55914b-14c7-4a64-8f85-5c3159b26080-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-db55914b-14c7-4a64-8f85-5c3159b26080" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-db55914b-14c7-4a64-8f85-5c3159b26080" acquired by "delete_volume" :: waited 0.036s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0909b963-a69d-4065-8ff7-86b6713aae0b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:11 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 Aug 05 15:46:11 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:11 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 1073741824" returned: 0 in 0.921s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:12 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 Aug 05 15:46:12 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (994626e3-2140-42af-b6d2-ecbb649e4be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24df1e9-8229-4ba2-899b-9a802166cd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24df1e9-8229-4ba2-899b-9a802166cd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623607888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0c643a-403e-46e1-99d8-2b723f29b279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:12Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f6a0fc-5dd1-4c6d-8fb4-ffdd8d072aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54f6a0fc-5dd1-4c6d-8fb4-ffdd8d072aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27802138-0e38-48f7-b742-385ddac5f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27802138-0e38-48f7-b742-385ddac5f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0c643a-403e-46e1-99d8-2b723f29b279', 'volume_name': 'volume-8b0c643a-403e-46e1-99d8-2b723f29b279', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8b360b-bb0f-4dab-8450-0ca089b5eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe8b360b-bb0f-4dab-8450-0ca089b5eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c657bc16-189d-4f38-8b4c-382dc6196d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:12 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Volume 8b0c643a-403e-46e1-99d8-2b723f29b279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0c643a-403e-46e1-99d8-2b723f29b279', 'volume_size': 1} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:12 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080" returned: 0 in 0.626s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:12 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50" returned: 0 in 0.325s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.526s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408720437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:10Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Creating volume 3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:12 devstack sudo[103161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080 Aug 05 15:46:12 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:12 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=203,cinder:SELECT=170,cinder:DELETE=15,cinder:INSERT=62 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:46:12 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 1073741824 Aug 05 15:46:12 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be2bc2a2-93ce-4953-bd5b-f80c628141a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acfb37a7-8ff0-4d19-8798-465aadbfee50', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20581130-1d0d-4b39-b1ba-f161741f854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:12 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Volume volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 (acfb37a7-8ff0-4d19-8798-465aadbfee50): created successfully Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20581130-1d0d-4b39-b1ba-f161741f854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (6121f3f9-f0fb-4add-89ca-891b5fdcf204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:12 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b027c864-b822-44b4-8e21-137fa7f1e669 tempest-CreateVolumesFromImageTest-2045362674 None] Created volume successfully. Aug 05 15:46:12 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-db55914b-14c7-4a64-8f85-5c3159b26080" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-db55914b-14c7-4a64-8f85-5c3159b26080" released by "delete_volume" :: held 0.990s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Created reservations ['1d9f4e74-059a-406b-b691-5a5e46a6b6ca', '451a8432-b304-4ce6-8880-565a633660cd', 'dfc96852-a63d-4740-9566-c32c77be2e63', '1e9c7cfa-c95c-42e8-8732-ef9e4b4ba6e8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:12 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:12 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:12 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 1073741824" returned: 0 in 0.546s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:13 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 Aug 05 15:46:13 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:13 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.302s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d5261e95-7953-4e1b-9748-59b2d973a78e tempest-VolumesGetTest-1525546891 None] Lock "cinder-db55914b-14c7-4a64-8f85-5c3159b26080-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:13 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.820s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1301296738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d0ed363-bbfa-4d35-b59c-bf67f8c0634a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:11Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Creating volume 6d0ed363-bbfa-4d35-b59c-bf67f8c0634a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:13 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f02ca597-3e17-44cf-aaf7-d571e6a886aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:13 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a 1073741824 Aug 05 15:46:13 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c1ff2d-3580-42ee-bbde-bbfb0aff8168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Volume volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 (3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613): created successfully Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c1ff2d-3580-42ee-bbde-bbfb0aff8168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (db7fcb44-7734-4255-ae0a-7d8e2fbff855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2aa84497-5c1c-40d9-91b5-8e9f617449ec tempest-CreateVolumesFromImageTest-2045362674 None] Created volume successfully. Aug 05 15:46:13 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a 1073741824" returned: 0 in 0.480s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:13 devstack sudo[103181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a Aug 05 15:46:13 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-f01c19c4-d8d1-4448-812b-17a7aae599a2-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Lock "cinder-f01c19c4-d8d1-4448-812b-17a7aae599a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-f01c19c4-d8d1-4448-812b-17a7aae599a2" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-f01c19c4-d8d1-4448-812b-17a7aae599a2" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[54159008-4dc5-4568-a24d-1a8ba750b26a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:14 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a" returned: 0 in 0.326s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623607888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b0c643a-403e-46e1-99d8-2b723f29b279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e5273c275654bc9acc72cc3421c0f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:12Z,use_quota=True,user_id='5467216e51ca4347b809fa1288dd0113',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Creating volume 8b0c643a-403e-46e1-99d8-2b723f29b279 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:14 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c053bd3-d3c2-4955-89c4-fbb970c78585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62df915-f3c0-412f-9efa-45471c1ba711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:14 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 1073741824 Aug 05 15:46:14 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Volume volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a (6d0ed363-bbfa-4d35-b59c-bf67f8c0634a): created successfully Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62df915-f3c0-412f-9efa-45471c1ba711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (73dec19b-7b36-429d-bbe6-c939d3a86442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:14 devstack sudo[103184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 Aug 05 15:46:14 devstack sudo[103184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-80d9597a-46f6-4fed-93c2-4231a4811327 tempest-CreateVolumesFromImageTest-2045362674 None] Created volume successfully. Aug 05 15:46:14 devstack sudo[103184]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2" returned: 0 in 0.493s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:14 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2 Aug 05 15:46:14 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:14 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 1073741824" returned: 0 in 0.565s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:14 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 Aug 05 15:46:14 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:14 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f01c19c4-d8d1-4448-812b-17a7aae599a2" returned: 0 in 0.287s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-f01c19c4-d8d1-4448-812b-17a7aae599a2" released by "delete_volume" :: held 0.846s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:14 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Created reservations ['9db7f2e5-34d3-4d23-afa1-01fec9ff3a1e', '6cb46762-d9f1-4e3a-b633-8fd6594c0919', 'ddee3aa5-4c17-4bcd-b363-6aa700b74d2c', '956b6ae1-f4a4-4dff-9f0f-63bd28734656'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:15 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:15 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:15 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c657bc16-189d-4f38-8b4c-382dc6196d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0c643a-403e-46e1-99d8-2b723f29b279', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19efcaa2-9127-4db7-b5a0-1f40170d36e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:15 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Volume volume-8b0c643a-403e-46e1-99d8-2b723f29b279 (8b0c643a-403e-46e1-99d8-2b723f29b279): created successfully Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19efcaa2-9127-4db7-b5a0-1f40170d36e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Flow 'volume_create_manager' (994626e3-2140-42af-b6d2-ecbb649e4be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b95d0cd7-508f-45e6-9f32-981ff31c0d65 tempest-CreateVolumesFromImageTest-2045362674 None] Created volume successfully. Aug 05 15:46:15 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-912515d7-a783-446f-b165-217a61f17896 tempest-VolumesGetTest-1525546891 None] Lock "cinder-f01c19c4-d8d1-4448-812b-17a7aae599a2-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-8b0c643a-403e-46e1-99d8-2b723f29b279-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-8b0c643a-403e-46e1-99d8-2b723f29b279-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-quobyte-8b0c643a-403e-46e1-99d8-2b723f29b279" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-8b0c643a-403e-46e1-99d8-2b723f29b279" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Flow 'volume_create_manager' (71d976fa-5c0c-488b-9d82-203ef738a0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28568670-87e0-4ad6-8acf-629d8e2c959b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[57602be1-7ee6-4c49-8cc8-087ef18733da]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28568670-87e0-4ad6-8acf-629d8e2c959b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2137531574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8329b946-c0a3-4f2c-beca-7668f4ba2ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58ca187df714f33b95e38ebec6254c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:16Z,use_quota=True,user_id='0101d68aaabf4d65b26d74f5001f1fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708c9663-401d-4baf-9f33-815d572dc8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (708c9663-401d-4baf-9f33-815d572dc8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83449d19-4c0b-4ab3-be77-fdf726f09dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83449d19-4c0b-4ab3-be77-fdf726f09dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8329b946-c0a3-4f2c-beca-7668f4ba2ddd', 'volume_name': 'volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3540f3b-4b20-41d3-aee2-15df29d6215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3540f3b-4b20-41d3-aee2-15df29d6215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de53e778-f263-4d87-905d-cb2924c73842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:15 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Volume 8329b946-c0a3-4f2c-beca-7668f4ba2ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd', 'volume_size': 1} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2137531574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8329b946-c0a3-4f2c-beca-7668f4ba2ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58ca187df714f33b95e38ebec6254c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:16Z,use_quota=True,user_id='0101d68aaabf4d65b26d74f5001f1fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Creating volume 8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:15 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:16 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd 1073741824 Aug 05 15:46:16 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:16 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 Aug 05 15:46:16 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (876a48bb-5b3e-40c0-a902-7adde080f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7bfeb8-0142-46b0-8eb9-92c7fcfbb477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7bfeb8-0142-46b0-8eb9-92c7fcfbb477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1314213309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dffae0-092d-4351-8de7-21db784821b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:16Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c27b7b0-fca2-4ed0-8637-cfb39a10a23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c27b7b0-fca2-4ed0-8637-cfb39a10a23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa02b5a9-2ad0-4c7f-ac13-c165c68bb07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:46:16 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279" returned: 0 in 0.487s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:16 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279 Aug 05 15:46:16 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:16 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd 1073741824" returned: 0 in 0.541s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:16 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd Aug 05 15:46:16 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa02b5a9-2ad0-4c7f-ac13-c165c68bb07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10dffae0-092d-4351-8de7-21db784821b2', 'volume_name': 'volume-10dffae0-092d-4351-8de7-21db784821b2', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c623625-68d9-43bd-9105-5e01c3643f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c623625-68d9-43bd-9105-5e01c3643f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0caccc6b-9e8b-4bc1-bc46-2c4be8477cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:16 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Volume 10dffae0-092d-4351-8de7-21db784821b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10dffae0-092d-4351-8de7-21db784821b2', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Trying to clone 10dffae0-092d-4351-8de7-21db784821b2 from image 84e9902b-fdcb-400c-bb6e-673761bd149d at location (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:46:16 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b0c643a-403e-46e1-99d8-2b723f29b279" returned: 0 in 0.326s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-8b0c643a-403e-46e1-99d8-2b723f29b279" released by "delete_volume" :: held 0.895s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Created reservations ['d7ee6f57-e9a8-4c43-8243-ddb1f8a92e15', '2b0c29a0-940d-4c7a-87f5-15c3c7174adc', '3939bf6b-fed3-4653-b712-3a3182a6dd31', '34e2b4c7-61e1-49da-8463-25c1e8598911'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:17 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:17 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:17 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" returned: 0 in 0.463s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de53e778-f263-4d87-905d-cb2924c73842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b72c72b-dd2e-4abc-a360-549275632aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:17 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Volume volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd (8329b946-c0a3-4f2c-beca-7668f4ba2ddd): created successfully Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b72c72b-dd2e-4abc-a360-549275632aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Flow 'volume_create_manager' (71d976fa-5c0c-488b-9d82-203ef738a0ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ab3fc62f-4dec-4aae-b12b-c57f029229c6 tempest-TestStampPattern-2054150877 None] Created volume successfully. Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:46:17 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Image download 20.69 MB at 20.69 MB/s Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c79efa-806b-42be-a163-654d74996a68]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:17 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Deleted volume successfully. Aug 05 15:46:17 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD Aug 05 15:46:17 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e9195090-8880-4eb2-9f12-05319d3e5aa0 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-8b0c643a-403e-46e1-99d8-2b723f29b279-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:17 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d is fetched for user 5cb6eeeb66cd4a5d9b287d9153a9985f. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf3c082-d0e5-47c2-8c06-72d935d2eb17]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:17 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD Aug 05 15:46:17 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:18 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1314213309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10dffae0-092d-4351-8de7-21db784821b2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:16Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Creating volume 10dffae0-092d-4351-8de7-21db784821b2 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:18 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:18 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 1073741824 Aug 05 15:46:18 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-quobyte-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9ad342-8e71-443f-94be-5ba746e2cd2b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:18 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a Aug 05 15:46:18 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:18 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 1073741824" returned: 0 in 0.600s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:18 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a" returned: 0 in 0.500s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:18 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a Aug 05 15:46:18 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:18 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 Aug 05 15:46:18 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:19 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a" released by "delete_volume" :: held 0.901s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:19 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2" returned: 0 in 0.421s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Created reservations ['dfd2db25-37c2-4f67-ab57-becdde86a169', '9a132572-4b1b-4ac6-9b35-25d1bd3b4bc4', '07ec3d1a-ed1a-40b6-bbb8-dc76100749b8', 'b7c31829-3fa1-40d2-8dc4-be3ed186304b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Attempting download of 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume 10dffae0-092d-4351-8de7-21db784821b2. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86d0d46-5540-4bc1-9eda-594f0e3d92b6]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:19 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:19 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:19 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07 Aug 05 15:46:19 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:19 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.261s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Deleted volume successfully. Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5b20bae4-2461-4549-802b-8f2aa381d264 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-6d0ed363-bbfa-4d35-b59c-bf67f8c0634a-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:19 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07" returned: 0 in 0.366s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:19 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07 Aug 05 15:46:19 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:20 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07" returned: 1 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84e9902b-fdcb-400c-bb6e-673761bd149d_cnovac07' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71ce95-bd76-4c6b-a251-4bffac8ca069]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:20 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD Aug 05 15:46:20 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-quobyte-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:20 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] 84e9902b-fdcb-400c-bb6e-673761bd149d was qcow2, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613" acquired by "delete_volume" :: waited 0.046s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:20 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 Aug 05 15:46:20 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb84fa-95c9-416f-b470-fbdcba8e7e1f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:20 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 Aug 05 15:46:20 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:21 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613" returned: 0 in 0.685s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:21 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613 Aug 05 15:46:21 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:21 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613" returned: 0 in 0.568s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613" released by "delete_volume" :: held 1.323s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:21 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Created reservations ['afc4cfa6-1083-461f-baeb-22a4a7b0a609', '9161c132-9f77-4ac9-aa6b-00610edc7a70', 'a46cf4d2-e994-458d-8f40-3d2e3662427e', '37dbe4dc-7b15-4d34-8c83-b1dcc8534be8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:22 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:22 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:22 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.333s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Deleted volume successfully. Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8b1de6c3-1df2-45ff-892f-470ae05c5d8a tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-3d8c7a9d-afe1-44cc-90b3-0f2e56b6d613-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-acfb37a7-8ff0-4d19-8798-465aadbfee50-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-acfb37a7-8ff0-4d19-8798-465aadbfee50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-quobyte-acfb37a7-8ff0-4d19-8798-465aadbfee50" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-acfb37a7-8ff0-4d19-8798-465aadbfee50" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e596ae8-ea9f-4723-9ba2-1cefe107ff1b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:22 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 Aug 05 15:46:22 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:22 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2" returned: 0 in 2.509s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84e9902b-fdcb-400c-bb6e-673761bd149d_n7xprs41devstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:46:22 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Converted 112.00 MB image at 44.60 MB/s Aug 05 15:46:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:22 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 1G Aug 05 15:46:22 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:23 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50" returned: 0 in 0.422s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:23 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50 Aug 05 15:46:23 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:23 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 1G" returned: 0 in 0.375s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Downloaded image 84e9902b-fdcb-400c-bb6e-673761bd149d ((None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}])) to volume 10dffae0-092d-4351-8de7-21db784821b2 successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Temporary image 84e9902b-fdcb-400c-bb6e-673761bd149d for user 5cb6eeeb66cd4a5d9b287d9153a9985f is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Marking volume 10dffae0-092d-4351-8de7-21db784821b2 as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Copying metadata from image 84e9902b-fdcb-400c-bb6e-673761bd149d to 10dffae0-092d-4351-8de7-21db784821b2. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Creating volume glance metadata for volume 10dffae0-092d-4351-8de7-21db784821b2 backed by image 84e9902b-fdcb-400c-bb6e-673761bd149d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0caccc6b-9e8b-4bc1-bc46-2c4be8477cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10dffae0-092d-4351-8de7-21db784821b2', 'volume_size': 1, 'image_id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84e9902b-fdcb-400c-bb6e-673761bd149d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '021064b5dc5a410f863445e23beddb55', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '84e9902b-fdcb-400c-bb6e-673761bd149d', 'created_at': datetime.datetime(2026, 8, 5, 13, 27, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 27, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84e9902b-fdcb-400c-bb6e-673761bd149d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51170c38-0782-4589-b06f-fe979ebc1d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:23 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Volume volume-10dffae0-092d-4351-8de7-21db784821b2 (10dffae0-092d-4351-8de7-21db784821b2): created successfully Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51170c38-0782-4589-b06f-fe979ebc1d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:23 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (876a48bb-5b3e-40c0-a902-7adde080f816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-acfb37a7-8ff0-4d19-8798-465aadbfee50" returned: 0 in 0.298s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-acfb37a7-8ff0-4d19-8798-465aadbfee50" released by "delete_volume" :: held 0.773s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6d3976c2-9772-467f-9640-a97ab0773388 tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Created reservations ['e16e13fd-7bb9-4789-8334-c22e02906d27', '1c78c632-bcdd-4906-be5a-3142eaaf6f10', '93caa641-577b-48f4-9097-5779eaddf4b5', '3b8f6d31-2af6-4502-89c9-94c62de7c76b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:23 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:23 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-a334b674-3962-43fa-806b-f1eb4f96f09a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-a334b674-3962-43fa-806b-f1eb4f96f09a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:24 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "cinder-quobyte-a334b674-3962-43fa-806b-f1eb4f96f09a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:24 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Deleted volume successfully. Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-a334b674-3962-43fa-806b-f1eb4f96f09a" acquired by "delete_volume" :: waited 0.037s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc570f2-aa65-49ff-8e0d-5a6a9e68a546]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a9650fc4-6a62-4ccd-aa12-2544d30214b1 tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-acfb37a7-8ff0-4d19-8798-465aadbfee50-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:24 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a Aug 05 15:46:24 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:24 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a" returned: 0 in 0.469s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:24 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a Aug 05 15:46:24 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (34fc01c7-d7ab-45fa-b8fa-150db99d36db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605fc4a7-ff1a-422f-b113-fe61b52bbc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (605fc4a7-ff1a-422f-b113-fe61b52bbc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1880713706',display_name='tempest-VolumesGetTest-Volume-801053713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d224cbd9-dc29-4878-b841-e7d54be12f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:25Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3576976-72d0-482c-881a-e8f9a3c3ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3576976-72d0-482c-881a-e8f9a3c3ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfbc8eb-2267-459a-a1ef-365542e3aa77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfbc8eb-2267-459a-a1ef-365542e3aa77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd224cbd9-dc29-4878-b841-e7d54be12f29', 'volume_name': 'volume-d224cbd9-dc29-4878-b841-e7d54be12f29', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930abab4-1b06-479b-bb01-b0aa4afb136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (930abab4-1b06-479b-bb01-b0aa4afb136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:25 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c002c0ca-1cb8-4595-ac81-50c34c14cc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:25 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Volume d224cbd9-dc29-4878-b841-e7d54be12f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d224cbd9-dc29-4878-b841-e7d54be12f29', 'volume_size': 1} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1880713706',display_name='tempest-VolumesGetTest-Volume-801053713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d224cbd9-dc29-4878-b841-e7d54be12f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f6a89a96f1494c83ad7284ec03ed3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:25Z,use_quota=True,user_id='5cb6eeeb66cd4a5d9b287d9153a9985f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Creating volume d224cbd9-dc29-4878-b841-e7d54be12f29 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:25 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a334b674-3962-43fa-806b-f1eb4f96f09a" returned: 0 in 0.378s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-quobyte-a334b674-3962-43fa-806b-f1eb4f96f09a" released by "delete_volume" :: held 0.921s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:25 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 1073741824 Aug 05 15:46:25 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Created reservations ['edfea43d-6a48-4b7a-9e1b-e949cd659f15', '672cdc88-221f-48c7-8cf3-61feaa87b57b', 'affb1b51-af94-41d6-afce-cebdfe897412', 'a51f39e0-6bdb-4613-86c4-b45e1b3aa7f1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:25 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:25 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:25 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:25 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 1073741824" returned: 0 in 0.628s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Deleted volume successfully. Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-476e70c9-f4ef-42d8-9108-c90d0c2edd7b tempest-CreateVolumesFromImageTest-2045362674 None] Lock "cinder-a334b674-3962-43fa-806b-f1eb4f96f09a-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:25 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 Aug 05 15:46:25 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:26 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29" returned: 0 in 0.306s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c002c0ca-1cb8-4595-ac81-50c34c14cc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d224cbd9-dc29-4878-b841-e7d54be12f29', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7173fa51-4623-478a-8cc7-55ecc7c0f6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Volume volume-d224cbd9-dc29-4878-b841-e7d54be12f29 (d224cbd9-dc29-4878-b841-e7d54be12f29): created successfully Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7173fa51-4623-478a-8cc7-55ecc7c0f6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Flow 'volume_create_manager' (34fc01c7-d7ab-45fa-b8fa-150db99d36db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5e42e88c-66d9-4186-8a6b-82fe4957e76e tempest-VolumesGetTest-1525546891 None] Created volume successfully. Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-d224cbd9-dc29-4878-b841-e7d54be12f29-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Lock "cinder-d224cbd9-dc29-4878-b841-e7d54be12f29-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-d224cbd9-dc29-4878-b841-e7d54be12f29" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-d224cbd9-dc29-4878-b841-e7d54be12f29" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[208cada6-8ab7-46c8-a6c1-2730f25486f9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:27 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 Aug 05 15:46:27 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:27 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29" returned: 0 in 0.569s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:28 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29 Aug 05 15:46:28 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:28 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-d224cbd9-dc29-4878-b841-e7d54be12f29" returned: 0 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-d224cbd9-dc29-4878-b841-e7d54be12f29" released by "delete_volume" :: held 0.987s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Created reservations ['bc3f3ab0-1d3b-47a2-9a02-8991d03f5bc5', '39dad73d-57e7-48e0-9cd8-8f7b4f8d9c7c', '24b8cd55-5116-4b22-9194-08442d802d3c', '963b968d-d24c-46ac-a982-1d1da6addcf6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:28 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:28 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:28 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.290s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:46:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb520a87-3a24-4cff-b7d4-ec52fcf03b7d tempest-VolumesGetTest-1525546891 None] Lock "cinder-d224cbd9-dc29-4878-b841-e7d54be12f29-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-10dffae0-092d-4351-8de7-21db784821b2-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Lock "cinder-10dffae0-092d-4351-8de7-21db784821b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Acquiring lock "cinder-quobyte-10dffae0-092d-4351-8de7-21db784821b2" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-10dffae0-092d-4351-8de7-21db784821b2" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[243b41a6-b4ea-4f35-991d-649946384707]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:29 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 Aug 05 15:46:29 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:30 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2" returned: 0 in 0.463s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:30 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2 Aug 05 15:46:30 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (75b47bd8-7bd6-44c8-b50e-41b14fb976b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c0251a-4366-479b-a26c-9f3acbb61773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c0251a-4366-479b-a26c-9f3acbb61773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892748679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9994dd64-615b-4744-9123-6b39c1093843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:30Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e09efb6-44ae-4f72-b96b-ca735b1d1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e09efb6-44ae-4f72-b96b-ca735b1d1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7e44c-b9af-4911-89ed-ce21cc72d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7e44c-b9af-4911-89ed-ce21cc72d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9994dd64-615b-4744-9123-6b39c1093843', 'volume_name': 'volume-9994dd64-615b-4744-9123-6b39c1093843', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e468e9-05a2-4682-b557-bf3eb625460a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e468e9-05a2-4682-b557-bf3eb625460a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4718a435-0f3b-4c18-bfac-0067ee6e968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:30 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume 9994dd64-615b-4744-9123-6b39c1093843: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9994dd64-615b-4744-9123-6b39c1093843', 'volume_size': 1} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892748679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9994dd64-615b-4744-9123-6b39c1093843,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:30Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Creating volume 9994dd64-615b-4744-9123-6b39c1093843 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:30 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:30 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 1073741824 Aug 05 15:46:30 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:30 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10dffae0-092d-4351-8de7-21db784821b2" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Lock "cinder-quobyte-10dffae0-092d-4351-8de7-21db784821b2" released by "delete_volume" :: held 0.795s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Created reservations ['c73dd3f9-fc5c-459c-b345-7e46bdafd4df', '83acb528-ea98-4f4d-a437-7cff93c36267', 'b64c5a59-aa57-4071-9d81-935e2a57d6ca', 'd1e432a5-e152-49ac-86f9-679d3c87300e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:30 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:30 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:30 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 1073741824" returned: 0 in 0.529s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:30 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.334s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:30 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 Aug 05 15:46:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Deleted volume successfully. Aug 05 15:46:30 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-74b11227-6f81-4db1-8e6e-fd2cde41ad65 tempest-VolumesGetTest-1525546891 None] Lock "cinder-10dffae0-092d-4351-8de7-21db784821b2-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:31 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4718a435-0f3b-4c18-bfac-0067ee6e968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9994dd64-615b-4744-9123-6b39c1093843', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed82ee6-424e-4a84-8b3f-2e25d37f4f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume volume-9994dd64-615b-4744-9123-6b39c1093843 (9994dd64-615b-4744-9123-6b39c1093843): created successfully Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed82ee6-424e-4a84-8b3f-2e25d37f4f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (75b47bd8-7bd6-44c8-b50e-41b14fb976b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7a5676e7-d80f-4a13-9b52-e062c9d6a5a3 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created volume successfully. Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (ed8e4b4c-60d1-45dd-99ff-9a09e2dd6666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6947f08-b6cc-4aaf-ab70-2fab1563fb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6947f08-b6cc-4aaf-ab70-2fab1563fb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-374818842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a426d35-e33d-4b4d-8fce-92a341581409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:33Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfe69ca-9940-4307-9694-13675523733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfe69ca-9940-4307-9694-13675523733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d71ba4-9ef2-4c90-8a51-0c2b2dfb0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d71ba4-9ef2-4c90-8a51-0c2b2dfb0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a426d35-e33d-4b4d-8fce-92a341581409', 'volume_name': 'volume-1a426d35-e33d-4b4d-8fce-92a341581409', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88f116f-cda6-4f2b-b479-73797e035aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88f116f-cda6-4f2b-b479-73797e035aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c962c7f2-ab39-4a0b-b950-efbb3f2df79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume 1a426d35-e33d-4b4d-8fce-92a341581409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a426d35-e33d-4b4d-8fce-92a341581409', 'volume_size': 1} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-374818842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a426d35-e33d-4b4d-8fce-92a341581409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:33Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Creating volume 1a426d35-e33d-4b4d-8fce-92a341581409 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:32 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:33 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 1073741824 Aug 05 15:46:33 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (4d0fb69b-07bb-45fa-9c5f-2dff8d31ad71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbbbb19-081a-4b2a-a29c-87b30442aee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbbbb19-081a-4b2a-a29c-87b30442aee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823272601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5785dac5-a7ef-4eaa-bb11-baffe2a64e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:33Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7b2758-21b5-4dd3-9a37-306469a4f435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7b2758-21b5-4dd3-9a37-306469a4f435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a187687-6cf6-468b-a810-5a851f575a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a187687-6cf6-468b-a810-5a851f575a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5785dac5-a7ef-4eaa-bb11-baffe2a64e0f', 'volume_name': 'volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28ab89-3f8a-4590-ae4c-49990cf278e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c28ab89-3f8a-4590-ae4c-49990cf278e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478e5814-e6f2-4745-9f40-925aba98aa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume 5785dac5-a7ef-4eaa-bb11-baffe2a64e0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f', 'volume_size': 1} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:33 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 1073741824" returned: 0 in 0.671s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:33 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 Aug 05 15:46:33 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (a117b141-3bfa-4f93-8243-6520b6baabc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bb15e8-e9a0-464a-abea-314c837b2fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bb15e8-e9a0-464a-abea-314c837b2fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-604417096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8db484-495f-4ec4-9e1d-2cc60a855635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:34Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4872c02-b7f4-45b3-9cee-b822ce52dcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4872c02-b7f4-45b3-9cee-b822ce52dcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd08d75-7c66-4c5c-a0b8-404ce125833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd08d75-7c66-4c5c-a0b8-404ce125833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed8db484-495f-4ec4-9e1d-2cc60a855635', 'volume_name': 'volume-ed8db484-495f-4ec4-9e1d-2cc60a855635', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac31018-cf74-43aa-b4fb-96606238097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac31018-cf74-43aa-b4fb-96606238097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c40169-1e5a-4584-b641-e9f816d6d972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume ed8db484-495f-4ec4-9e1d-2cc60a855635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed8db484-495f-4ec4-9e1d-2cc60a855635', 'volume_size': 1} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409" returned: 0 in 0.499s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.693s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1823272601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5785dac5-a7ef-4eaa-bb11-baffe2a64e0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:33Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Creating volume 5785dac5-a7ef-4eaa-bb11-baffe2a64e0f {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:34 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c962c7f2-ab39-4a0b-b950-efbb3f2df79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a426d35-e33d-4b4d-8fce-92a341581409', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f 1073741824 Aug 05 15:46:34 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749c273c-f6c3-406b-8581-efd34cf3bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume volume-1a426d35-e33d-4b4d-8fce-92a341581409 (1a426d35-e33d-4b4d-8fce-92a341581409): created successfully Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749c273c-f6c3-406b-8581-efd34cf3bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (ed8e4b4c-60d1-45dd-99ff-9a09e2dd6666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f593bdba-bdcf-4d75-8a9e-6a6db8241162 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created volume successfully. Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (4e479303-eb65-4b8b-9937-b2ade9dd2318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ea25ca-e52e-44d4-976d-690b6837f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ea25ca-e52e-44d4-976d-690b6837f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707809755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:35Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21803d97-7e25-4fe4-ba61-a2b055385345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21803d97-7e25-4fe4-ba61-a2b055385345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ab6e8c-6637-4091-99a4-4c5d6a81c81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ab6e8c-6637-4091-99a4-4c5d6a81c81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4', 'volume_name': 'volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8894987-68e1-44ae-b0ad-0437f3c48835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8894987-68e1-44ae-b0ad-0437f3c48835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91123698-2fbf-4701-8948-8c0d07961edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume 9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4', 'volume_size': 1} Aug 05 15:46:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:35 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f 1073741824" returned: 0 in 0.792s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:35 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f Aug 05 15:46:35 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Flow 'volume_create_manager' (f1b535d7-62a0-4d39-8854-142b7d0d5a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfee9f0-73c1-485a-a61d-de96de799f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfee9f0-73c1-485a-a61d-de96de799f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2042531427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0ce770-5884-43df-bb9b-47065d9ae21b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aab8cc712e5741668728b8213c572fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:35Z,use_quota=True,user_id='dd7d62a240424023a60fbaecd6d412fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0392c84-1c12-48e5-a7f6-7dc60915d398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0392c84-1c12-48e5-a7f6-7dc60915d398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d885e5c-41a2-4b8c-a531-d10609086168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d885e5c-41a2-4b8c-a531-d10609086168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0ce770-5884-43df-bb9b-47065d9ae21b', 'volume_name': 'volume-1b0ce770-5884-43df-bb9b-47065d9ae21b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789a5436-3d7d-469f-8f38-85aacd37d990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789a5436-3d7d-469f-8f38-85aacd37d990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980bea21-106f-424a-a7fc-f62924f84132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Volume 1b0ce770-5884-43df-bb9b-47065d9ae21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0ce770-5884-43df-bb9b-47065d9ae21b', 'volume_size': 1} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (86c796af-2f59-4505-882e-90a952e84e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e41e502-6954-42d1-a518-bce9ef714d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e41e502-6954-42d1-a518-bce9ef714d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715191483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:35Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af4ce8f-7738-4e4b-a348-5207d5d1e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6af4ce8f-7738-4e4b-a348-5207d5d1e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b690e28e-8afc-4a27-8750-02b820b1adea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b690e28e-8afc-4a27-8750-02b820b1adea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5', 'volume_name': 'volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7a3923-df10-4f0c-9186-cd135c81f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7a3923-df10-4f0c-9186-cd135c81f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ed3f7f-0ea3-4521-ad84-ee8664573d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume 0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5', 'volume_size': 1} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f" returned: 0 in 0.459s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.315s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-604417096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed8db484-495f-4ec4-9e1d-2cc60a855635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:34Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Creating volume ed8db484-495f-4ec4-9e1d-2cc60a855635 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:35 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478e5814-e6f2-4745-9f40-925aba98aa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 1073741824 Aug 05 15:46:35 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb39fe5-a3f5-4232-8bb1-b47ce8a0756c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f (5785dac5-a7ef-4eaa-bb11-baffe2a64e0f): created successfully Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb39fe5-a3f5-4232-8bb1-b47ce8a0756c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (4d0fb69b-07bb-45fa-9c5f-2dff8d31ad71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7b529313-4d43-48af-a056-9192606ed832 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created volume successfully. Aug 05 15:46:35 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 1073741824" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:36 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 Aug 05 15:46:36 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:36 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707809755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:35Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Creating volume 9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:36 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c40169-1e5a-4584-b641-e9f816d6d972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed8db484-495f-4ec4-9e1d-2cc60a855635', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:36 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 1073741824 Aug 05 15:46:36 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3384b0-62a7-49d4-a0bd-8343160f22ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:36 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 (ed8db484-495f-4ec4-9e1d-2cc60a855635): created successfully Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3384b0-62a7-49d4-a0bd-8343160f22ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (a117b141-3bfa-4f93-8243-6520b6baabc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fd35a087-71e3-41ac-bfee-48c9f3a242c6 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created volume successfully. Aug 05 15:46:36 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 1073741824" returned: 0 in 0.434s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:36 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 Aug 05 15:46:36 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:37 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.652s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2042531427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0ce770-5884-43df-bb9b-47065d9ae21b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aab8cc712e5741668728b8213c572fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:35Z,use_quota=True,user_id='dd7d62a240424023a60fbaecd6d412fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Creating volume 1b0ce770-5884-43df-bb9b-47065d9ae21b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:37 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91123698-2fbf-4701-8948-8c0d07961edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:37 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b 1073741824 Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609ff6c2-2790-491a-9a65-99a6d4565421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:37 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:37 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 (9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4): created successfully Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609ff6c2-2790-491a-9a65-99a6d4565421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (4e479303-eb65-4b8b-9937-b2ade9dd2318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e0ec7653-f077-4316-b9ec-d85ea6f086d2 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created volume successfully. Aug 05 15:46:37 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b 1073741824" returned: 0 in 0.435s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:37 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b Aug 05 15:46:37 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:37 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.257s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1715191483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='028608bb2a3340f7a39b3852bda1f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:35Z,use_quota=True,user_id='b8d64532c4264e3bbc1ce764d3d0a6b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Creating volume 0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:37 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980bea21-106f-424a-a7fc-f62924f84132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0ce770-5884-43df-bb9b-47065d9ae21b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020eb6a6-3941-4861-a33b-ec800b283177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:37 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 1073741824 Aug 05 15:46:37 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:37 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Volume volume-1b0ce770-5884-43df-bb9b-47065d9ae21b (1b0ce770-5884-43df-bb9b-47065d9ae21b): created successfully Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (020eb6a6-3941-4861-a33b-ec800b283177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Flow 'volume_create_manager' (f1b535d7-62a0-4d39-8854-142b7d0d5a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-49a1d11d-79a6-41c6-a34b-7731cd1d1a90 tempest-VolumesListTestJSON-1890487004 None] Created volume successfully. Aug 05 15:46:38 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 1073741824" returned: 0 in 0.511s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:38 devstack sudo[103536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 Aug 05 15:46:38 devstack sudo[103536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Flow 'volume_create_manager' (0ce18c52-8571-41f1-8c19-52ece18a345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4ed46f-196b-424f-8bd5-511be6245955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4ed46f-196b-424f-8bd5-511be6245955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101288200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead38e9-9ade-4f65-8485-d620d11cfc69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aab8cc712e5741668728b8213c572fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:38Z,use_quota=True,user_id='dd7d62a240424023a60fbaecd6d412fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8141f76-43f2-4ff8-badf-97607dd5d613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8141f76-43f2-4ff8-badf-97607dd5d613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7072847-7d18-44d3-a744-cafcc3fb30fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7072847-7d18-44d3-a744-cafcc3fb30fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fead38e9-9ade-4f65-8485-d620d11cfc69', 'volume_name': 'volume-fead38e9-9ade-4f65-8485-d620d11cfc69', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9fc795-bdbf-40e9-9dbe-93e1bf7687f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9fc795-bdbf-40e9-9dbe-93e1bf7687f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d4eb56-d3dc-434e-92c7-8c2ce51e9554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Volume fead38e9-9ade-4f65-8485-d620d11cfc69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fead38e9-9ade-4f65-8485-d620d11cfc69', 'volume_size': 1} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:38 devstack sudo[103536]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101288200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fead38e9-9ade-4f65-8485-d620d11cfc69,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aab8cc712e5741668728b8213c572fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:38Z,use_quota=True,user_id='dd7d62a240424023a60fbaecd6d412fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Creating volume fead38e9-9ade-4f65-8485-d620d11cfc69 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:38 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ed3f7f-0ea3-4521-ad84-ee8664573d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:38 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 1073741824 Aug 05 15:46:38 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b84290-8e1d-4096-b887-ff3c824efd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Volume volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 (0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5): created successfully Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b84290-8e1d-4096-b887-ff3c824efd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Flow 'volume_create_manager' (86c796af-2f59-4505-882e-90a952e84e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b7fca5b8-a674-4e6d-87c7-198519df5a20 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created volume successfully. Aug 05 15:46:39 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 1073741824" returned: 0 in 0.438s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:39 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 Aug 05 15:46:39 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:39 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69" returned: 0 in 0.231s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d4eb56-d3dc-434e-92c7-8c2ce51e9554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fead38e9-9ade-4f65-8485-d620d11cfc69', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef74dcad-21ba-4352-9844-c997ff8c215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Volume volume-fead38e9-9ade-4f65-8485-d620d11cfc69 (fead38e9-9ade-4f65-8485-d620d11cfc69): created successfully Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef74dcad-21ba-4352-9844-c997ff8c215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Flow 'volume_create_manager' (0ce18c52-8571-41f1-8c19-52ece18a345d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a1bfeab7-4cb2-49a3-add6-f6aaf7846d2b tempest-VolumesListTestJSON-1890487004 None] Created volume successfully. Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-quobyte-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcae9f8-c243-4a22-9481-5594b9b9bbe7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:40 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 Aug 05 15:46:40 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Flow 'volume_create_manager' (eb789d70-97c8-409c-b643-75eb5b5e7529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2aeee0-25ff-4dc5-9f20-fe4bea098f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b2aeee0-25ff-4dc5-9f20-fe4bea098f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1441627641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc37e3fb-a2d8-45b1-bfda-f3c98aedb454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aab8cc712e5741668728b8213c572fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:40Z,use_quota=True,user_id='dd7d62a240424023a60fbaecd6d412fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be69cad-4763-46b4-a839-c7d1aec82f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be69cad-4763-46b4-a839-c7d1aec82f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454aa848-ca6b-42df-aa12-6695321f8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454aa848-ca6b-42df-aa12-6695321f8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc37e3fb-a2d8-45b1-bfda-f3c98aedb454', 'volume_name': 'volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c120e7ef-5900-49dc-ae67-7c47c2f26df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c120e7ef-5900-49dc-ae67-7c47c2f26df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cdb042-7a75-4cb3-b790-c7987accb1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:40 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Volume fc37e3fb-a2d8-45b1-bfda-f3c98aedb454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454', 'volume_size': 1} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:46:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1441627641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc37e3fb-a2d8-45b1-bfda-f3c98aedb454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='aab8cc712e5741668728b8213c572fac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:46:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:46:40Z,use_quota=True,user_id='dd7d62a240424023a60fbaecd6d412fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Creating volume fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:46:40 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:40 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 1073741824 Aug 05 15:46:40 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:40 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5" returned: 0 in 0.363s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:40 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5 Aug 05 15:46:40 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:40 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5" returned: 0 in 0.281s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5" released by "delete_volume" :: held 0.694s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created reservations ['0ceceba8-a836-4c40-9a7b-ba1280ee0657', '9aa6adde-5fb1-4b90-98e3-44190df33502', 'a1770767-6ef4-451c-8cad-a9499fcad424', 'ecf3f631-f8f4-4f67-9dda-ce0f0140271e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:40 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 1073741824" returned: 0 in 0.480s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:40 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:40 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:40 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 Aug 05 15:46:40 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:40 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:40 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Deleted volume successfully. Aug 05 15:46:40 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454" returned: 0 in 0.291s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:46:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cdb042-7a75-4cb3-b790-c7987accb1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6382dd00-b653-4234-a611-9cf257bfe09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f5a92d53-0943-45ef-82eb-a9645da7c444 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-0eb9aa3d-411e-4b95-a3a3-e40d107ebfb5-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:41 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Volume volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 (fc37e3fb-a2d8-45b1-bfda-f3c98aedb454): created successfully Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6382dd00-b653-4234-a611-9cf257bfe09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Flow 'volume_create_manager' (eb789d70-97c8-409c-b643-75eb5b5e7529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:46:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-085d89e2-7f7c-4fa7-81a0-738994af8313 tempest-VolumesListTestJSON-1890487004 None] Created volume successfully. Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-quobyte-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af7efae-5125-43a7-aa66-54be02716b8a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:41 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 Aug 05 15:46:41 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:41 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4" returned: 0 in 0.388s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:41 devstack sudo[103581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4 Aug 05 15:46:41 devstack sudo[103581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:41 devstack sudo[103581]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4" released by "delete_volume" :: held 0.674s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created reservations ['a778be6b-db06-4f1b-a784-f41e74c46687', '4af5116f-ecac-4fca-80cc-b558e29052bc', 'ab4d1527-f388-4adf-8f73-4e57156ca7ec', '7b23f7a1-e682-43c7-a12f-2b400120d5cb'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:41 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:41 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:42 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.250s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Deleted volume successfully. Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-ed8db484-495f-4ec4-9e1d-2cc60a855635-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-934102e5-7cfe-410a-9e9b-b1315f66da34 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-9a9c71e1-4cb9-4ec4-870c-8767e35fd9a4-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-ed8db484-495f-4ec4-9e1d-2cc60a855635-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-quobyte-ed8db484-495f-4ec4-9e1d-2cc60a855635" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-ed8db484-495f-4ec4-9e1d-2cc60a855635" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5324b2-ccfc-4081-8928-d3e78e8912b2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:42 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 Aug 05 15:46:42 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:42 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635" returned: 0 in 0.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:42 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635 Aug 05 15:46:42 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:42 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ed8db484-495f-4ec4-9e1d-2cc60a855635" returned: 0 in 0.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-ed8db484-495f-4ec4-9e1d-2cc60a855635" released by "delete_volume" :: held 0.686s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:42 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created reservations ['8f69e49d-5471-405a-9373-2c28fd4b7ac7', '6bdcc0f4-7f65-4d13-b407-a5d610e0a997', '562883cf-3f6c-4ded-af67-d9a6d165e5ac', '144477f3-784e-40d7-a300-96143310a2ba'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:43 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:43 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:43 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.274s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:43 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Deleted volume successfully. Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fb7664f8-1005-423d-b405-5c4c46cae786 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-ed8db484-495f-4ec4-9e1d-2cc60a855635-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-quobyte-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5c08a8-b002-4963-8d31-fb0d3ea9c7fe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:43 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f Aug 05 15:46:43 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:43 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:44 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f Aug 05 15:46:44 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:44 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f" returned: 0 in 0.316s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f" released by "delete_volume" :: held 0.827s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created reservations ['a76ebd26-508d-4dda-9ba3-90eb461fb834', '92cd584c-768b-485c-86bf-8ea2a73a25c1', 'f5241f7e-fcfd-403a-9b65-16a1697cf440', 'f0fd67e6-fdae-4b20-97fe-d1c891225a8f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:44 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:44 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "cinder-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-1a426d35-e33d-4b4d-8fce-92a341581409-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-1a426d35-e33d-4b4d-8fce-92a341581409-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "cinder-quobyte-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-quobyte-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-quobyte-1a426d35-e33d-4b4d-8fce-92a341581409" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[236d6ccc-30ef-4288-aced-11d381b7e46d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-1a426d35-e33d-4b4d-8fce-92a341581409" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a71389d-ae0f-4420-a265-a87b704cf4d8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:44 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.389s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Deleted volume successfully. Aug 05 15:46:44 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 Aug 05 15:46:44 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa0de39a-600e-4ee5-ae5a-390e06851b19 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-5785dac5-a7ef-4eaa-bb11-baffe2a64e0f-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:44 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 Aug 05 15:46:44 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:45 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454" returned: 0 in 0.426s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:45 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:45 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454 Aug 05 15:46:45 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409" returned: 0 in 0.407s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:45 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409 Aug 05 15:46:45 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:45 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454" returned: 0 in 0.255s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:45 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-quobyte-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454" released by "delete_volume" :: held 0.723s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1a426d35-e33d-4b4d-8fce-92a341581409" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-1a426d35-e33d-4b4d-8fce-92a341581409" released by "delete_volume" :: held 0.691s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Created reservations ['0e8b122f-3309-4ec0-b077-6c3a648826d6', '36d3a802-16ac-4e9d-9583-60c6bee80b8f', '903d67b3-10ef-48e1-ac98-5ee887a318ee', '71211f39-f1ce-4a0c-b8ae-68d4feb08102'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created reservations ['1c1b2da0-cd49-4f6c-a355-7c2b2207fabf', '7cfbee63-5f68-4950-baae-7332354d5e9f', '97b952d1-2fd0-4f53-914d-352641f8a03c', 'ff7a0ef7-5d67-4786-8986-bf2b69f34d1f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:45 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:45 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:45 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:45 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-9994dd64-615b-4744-9123-6b39c1093843-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-9994dd64-615b-4744-9123-6b39c1093843-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "cinder-fead38e9-9ade-4f65-8485-d620d11cfc69-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:45 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.315s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-fead38e9-9ade-4f65-8485-d620d11cfc69-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Deleted volume successfully. Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "cinder-quobyte-9994dd64-615b-4744-9123-6b39c1093843" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-9994dd64-615b-4744-9123-6b39c1093843" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:45 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a573db8-413b-4332-b880-8795d7a68897 tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-fc37e3fb-a2d8-45b1-bfda-f3c98aedb454-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Deleted volume successfully. Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ff30d6-90ab-4270-a0ca-01c5466e70ca]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "cinder-quobyte-fead38e9-9ade-4f65-8485-d620d11cfc69" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-42b965a2-84cf-4dc3-b51a-7eaa5f829efb tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-1a426d35-e33d-4b4d-8fce-92a341581409-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-quobyte-fead38e9-9ade-4f65-8485-d620d11cfc69" acquired by "delete_volume" :: waited 0.045s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c23f6-c586-44e3-9369-045f500ae0cc]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:46 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 Aug 05 15:46:46 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:46 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 Aug 05 15:46:46 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:46 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843" returned: 0 in 0.377s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:46 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843 Aug 05 15:46:46 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:46 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69" returned: 0 in 0.371s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:46 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69 Aug 05 15:46:46 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:46 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9994dd64-615b-4744-9123-6b39c1093843" returned: 0 in 0.238s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-quobyte-9994dd64-615b-4744-9123-6b39c1093843" released by "delete_volume" :: held 0.675s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Created reservations ['fb393d35-f681-4f17-b3f5-8daa48346bc7', '816724c4-1c73-4834-9699-4d25fa676fed', 'f8ac1bd9-2812-4d81-9e84-b9515dd0a0ec', '9b67a00f-7e6f-49aa-8bdd-a2c1263d8383'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:46 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fead38e9-9ade-4f65-8485-d620d11cfc69" returned: 0 in 0.239s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-quobyte-fead38e9-9ade-4f65-8485-d620d11cfc69" released by "delete_volume" :: held 0.663s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Created reservations ['e58fa93e-0091-486e-a0f5-c30d3b26ee1d', '7a54f347-3c24-4f5f-97e8-9a76a4d34642', '82a87f87-024a-435a-8571-a5793fbff97c', '5aa5689d-e1bc-410c-9063-c7f0068332e9'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:46 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:46 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:46 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:46 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:47 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.284s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Deleted volume successfully. Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b57b89dc-0567-4b37-bd63-8ee14c87b123 tempest-CreateVolumesFromSourceVolumeTest-606027907 None] Lock "cinder-9994dd64-615b-4744-9123-6b39c1093843-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "cinder-1b0ce770-5884-43df-bb9b-47065d9ae21b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:47 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.343s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-1b0ce770-5884-43df-bb9b-47065d9ae21b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Deleted volume successfully. Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5eced270-d088-4863-90c5-5d0f1b9fdddf tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-fead38e9-9ade-4f65-8485-d620d11cfc69-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "cinder-quobyte-1b0ce770-5884-43df-bb9b-47065d9ae21b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-quobyte-1b0ce770-5884-43df-bb9b-47065d9ae21b" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c5e21c-b994-4a13-8c8e-75874356748e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:47 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b Aug 05 15:46:47 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:47 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b" returned: 0 in 0.427s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:47 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b Aug 05 15:46:47 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:47 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1b0ce770-5884-43df-bb9b-47065d9ae21b" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-quobyte-1b0ce770-5884-43df-bb9b-47065d9ae21b" released by "delete_volume" :: held 0.762s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Created reservations ['bb262193-57b5-471c-9cf8-02855d9eedbb', 'd39941be-3ddb-4780-b0e4-16bd825ba45f', 'af59ed07-1501-42b8-af13-4ee7db1e4479', '7db3ccdd-c791-479f-ac6a-56547ecfb993'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:48 devstack sudo[103669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:46:48 devstack sudo[103669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:48 devstack sudo[103669]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:46:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Deleted volume successfully. Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fdcad4aa-e25e-4c9a-8039-4b1d5d0c50cc tempest-VolumesListTestJSON-1890487004 None] Lock "cinder-1b0ce770-5884-43df-bb9b-47065d9ae21b-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d4997e00-0865-4180-8eae-3b39dfbd9f33 req-e2467430-2709-4206-9e25-565f9689c92d tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d4997e00-0865-4180-8eae-3b39dfbd9f33 req-e2467430-2709-4206-9e25-565f9689c92d tempest-TestStampPattern-2054150877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d4997e00-0865-4180-8eae-3b39dfbd9f33 req-e2467430-2709-4206-9e25-565f9689c92d tempest-TestStampPattern-2054150877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-d4997e00-0865-4180-8eae-3b39dfbd9f33 req-e2467430-2709-4206-9e25-565f9689c92d tempest-TestStampPattern-2054150877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06ecc382-602a-4fc5-91b6-b2093ec76f58', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:46:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-d4997e00-0865-4180-8eae-3b39dfbd9f33 req-e2467430-2709-4206-9e25-565f9689c92d tempest-TestStampPattern-2054150877 None] attachment_update completed successfully. Aug 05 15:46:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-767e067c-c6fa-4a30-85de-7b6a642507fd req-295b53c6-fdfe-4e66-87ae-e42d66134b0e tempest-TestStampPattern-2054150877 None] Terminate volume connection completed successfully. Aug 05 15:46:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-767e067c-c6fa-4a30-85de-7b6a642507fd req-295b53c6-fdfe-4e66-87ae-e42d66134b0e tempest-TestStampPattern-2054150877 None] Deleting attachment 06ecc382-602a-4fc5-91b6-b2093ec76f58. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:46:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:46:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:46:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Creating offline snapshot 32458150-2da9-483e-94b4-2b9bbc8f59a6 of volume 8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:46:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[663717ff-8e14-4ff5-8ec9-d0604b93f971]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:46:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:55 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd Aug 05 15:46:55 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:56 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" returned: 0 in 0.387s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:56 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 1G Aug 05 15:46:56 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:56 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 1G" returned: 0 in 0.679s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:56 devstack sudo[104134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 Aug 05 15:46:56 devstack sudo[104134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:57 devstack sudo[104134]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6" returned: 0 in 0.370s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:57 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 is being set with open permissions: ugo+rw Aug 05 15:46:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:57 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 Aug 05 15:46:57 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:57 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6" returned: 0 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:57 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info Aug 05 15:46:57 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:57 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info" returned: 0 in 0.365s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:57 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info is being set with open permissions: ugo+rw Aug 05 15:46:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:46:58 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info Aug 05 15:46:58 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:46:58 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Aug 05 15:46:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.info" returned: 0 in 0.365s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:46:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:46:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-15bd03a6-2d99-4eed-9bdb-10d1b62ddb67 tempest-TestStampPattern-2054150877 None] Create snapshot completed successfully Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (5c52d362-6dcf-454b-930d-4a362a114b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885fde9e-ef0e-40fe-a732-6f2b625a86dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885fde9e-ef0e-40fe-a732-6f2b625a86dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440185450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35d207f-97bb-4559-bcac-2793ff111cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:03Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951e3af4-f9d3-4b14-93d5-db5be775e672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951e3af4-f9d3-4b14-93d5-db5be775e672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9807592-d216-49eb-99c4-56522147283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9807592-d216-49eb-99c4-56522147283a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35d207f-97bb-4559-bcac-2793ff111cad', 'volume_name': 'volume-f35d207f-97bb-4559-bcac-2793ff111cad', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ecba53-f581-4c6e-a9de-0805bba5c268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0ecba53-f581-4c6e-a9de-0805bba5c268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c651d9a0-72e5-4c5e-b871-965e93184318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:03 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Volume f35d207f-97bb-4559-bcac-2793ff111cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35d207f-97bb-4559-bcac-2793ff111cad', 'volume_size': 1} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440185450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f35d207f-97bb-4559-bcac-2793ff111cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:03Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Creating volume f35d207f-97bb-4559-bcac-2793ff111cad {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:47:03 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:03 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad 1073741824 Aug 05 15:47:03 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:03 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad 1073741824" returned: 0 in 0.593s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:04 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad Aug 05 15:47:04 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:04 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad" returned: 0 in 0.340s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c651d9a0-72e5-4c5e-b871-965e93184318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35d207f-97bb-4559-bcac-2793ff111cad', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0e17a5-7e03-49e2-92d9-b0619bd1091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:04 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Volume volume-f35d207f-97bb-4559-bcac-2793ff111cad (f35d207f-97bb-4559-bcac-2793ff111cad): created successfully Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f0e17a5-7e03-49e2-92d9-b0619bd1091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (5c52d362-6dcf-454b-930d-4a362a114b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6b4dbcc2-62fa-48eb-bac2-55f1bf376eaf tempest-ProjectReaderTests-1075061021 None] Created volume successfully. Aug 05 15:47:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-f35d207f-97bb-4559-bcac-2793ff111cad-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-f35d207f-97bb-4559-bcac-2793ff111cad-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-quobyte-f35d207f-97bb-4559-bcac-2793ff111cad" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-f35d207f-97bb-4559-bcac-2793ff111cad" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:05 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ce503-459a-48bd-a586-7aa867013cb4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:06 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad Aug 05 15:47:06 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:06 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad" returned: 0 in 0.407s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:06 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad Aug 05 15:47:06 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:06 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f35d207f-97bb-4559-bcac-2793ff111cad" returned: 0 in 0.338s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-f35d207f-97bb-4559-bcac-2793ff111cad" released by "delete_volume" :: held 0.795s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Created reservations ['54761278-7577-4fd2-bfcf-5d5dd4a39ec6', 'bceda0cf-cd3c-416c-943f-0a468922d9df', 'faf26b8a-0d9c-41c1-a3eb-ab9611eb8dca', 'ee5440bd-5375-4161-95f2-7bedaa323fcd'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:06 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:47:06 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:07 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.360s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Deleted volume successfully. Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-057d325e-33c6-4b95-9d1e-1f2018389c36 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-f35d207f-97bb-4559-bcac-2793ff111cad-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Flow 'volume_create_manager' (b5fb693b-1cdd-4b49-9094-72c967dc4575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ec9ba-ee8b-4610-8af2-2af1da69c27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ec9ba-ee8b-4610-8af2-2af1da69c27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1449339480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b61905-d316-4ca8-9bdb-c06b849ede46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58ca187df714f33b95e38ebec6254c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32458150-2da9-483e-94b4-2b9bbc8f59a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:07Z,use_quota=True,user_id='0101d68aaabf4d65b26d74f5001f1fce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30ec5cf-f61f-4e5d-bd88-aa2ed6990d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30ec5cf-f61f-4e5d-bd88-aa2ed6990d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a508c25-1bff-4589-8f49-54dc7db05bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a508c25-1bff-4589-8f49-54dc7db05bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38b61905-d316-4ca8-9bdb-c06b849ede46', 'volume_name': 'volume-38b61905-d316-4ca8-9bdb-c06b849ede46', 'volume_size': 1, 'snapshot_id': '32458150-2da9-483e-94b4-2b9bbc8f59a6'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffade8d0-1816-46a7-a1ed-c41290cbb26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffade8d0-1816-46a7-a1ed-c41290cbb26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09114d6e-6f95-4703-884c-3743b1c2bd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Volume 38b61905-d316-4ca8-9bdb-c06b849ede46: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38b61905-d316-4ca8-9bdb-c06b849ede46', 'volume_size': 1, 'snapshot_id': '32458150-2da9-483e-94b4-2b9bbc8f59a6'} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-quobyte-32458150-2da9-483e-94b4-2b9bbc8f59a6-38b61905-d316-4ca8-9bdb-c06b849ede46" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-32458150-2da9-483e-94b4-2b9bbc8f59a6-38b61905-d316-4ca8-9bdb-c06b849ede46" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Creating volume 38b61905-d316-4ca8-9bdb-c06b849ede46 from snapshot 32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-quobyte-38b61905-d316-4ca8-9bdb-c06b849ede46" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-38b61905-d316-4ca8-9bdb-c06b849ede46" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] snapshot: 32458150-2da9-483e-94b4-2b9bbc8f59a6, volume: 38b61905-d316-4ca8-9bdb-c06b849ede46, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[02190423-1b1f-4c1c-be0b-92bd358fc582]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:07 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 Aug 05 15:47:07 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (d0d0c306-83a9-4456-b19f-9ebf4257f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4d3004-01b6-4248-bb47-72ec8f6560de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4d3004-01b6-4248-bb47-72ec8f6560de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997000574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd067c-0e8a-4122-b1f7-1adc842b7f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:08Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0841377-0cc9-4d52-ac3d-11e5c852e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0841377-0cc9-4d52-ac3d-11e5c852e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1314f6f4-79b4-4276-977f-527aa887c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1314f6f4-79b4-4276-977f-527aa887c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfd067c-0e8a-4122-b1f7-1adc842b7f5e', 'volume_name': 'volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff105304-de65-4a5e-9518-10761e6f31c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff105304-de65-4a5e-9518-10761e6f31c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805c672d-c739-437d-b52c-1a0c8a32c2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Volume bbfd067c-0e8a-4122-b1f7-1adc842b7f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e', 'volume_size': 1} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:08 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6" returned: 0 in 0.600s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3bd5b3-e565-4f32-a1c0-6cfb2394f997]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:08 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd Aug 05 15:47:08 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:08 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" returned: 0 in 0.434s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:47:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:08 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 Aug 05 15:47:08 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:10 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:47:10 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:10 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.459s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:47:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:47:15 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46" returned: 0 in 6.881s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:47:15 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Converted 1024.00 MB image at 148.80 MB/s Aug 05 15:47:15 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 is being set with open permissions: ugo+rw Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:15 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 Aug 05 15:47:15 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:15 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46" returned: 0 in 0.356s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-38b61905-d316-4ca8-9bdb-c06b849ede46" released by "_copy_volume_from_snapshot" :: held 8.427s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=149,cinder:INSERT=54,cinder:UPDATE=192,cinder:DELETE=23 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:15 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=222,cinder:DELETE=16,cinder:SELECT=146,cinder:INSERT=52 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-32458150-2da9-483e-94b4-2b9bbc8f59a6-38b61905-d316-4ca8-9bdb-c06b849ede46" released by "_create_volume_from_snapshot" :: held 8.623s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.650s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.945s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-997000574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfd067c-0e8a-4122-b1f7-1adc842b7f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:08Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Creating volume bbfd067c-0e8a-4122-b1f7-1adc842b7f5e {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:47:16 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:16 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e 1073741824 Aug 05 15:47:16 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09114d6e-6f95-4703-884c-3743b1c2bd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b61905-d316-4ca8-9bdb-c06b849ede46', 'volume_size': 1, 'snapshot_id': '32458150-2da9-483e-94b4-2b9bbc8f59a6'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f69e275-5070-410c-afa7-e7ca2e183000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:16 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Volume volume-38b61905-d316-4ca8-9bdb-c06b849ede46 (38b61905-d316-4ca8-9bdb-c06b849ede46): created successfully Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f69e275-5070-410c-afa7-e7ca2e183000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Flow 'volume_create_manager' (b5fb693b-1cdd-4b49-9094-72c967dc4575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b44d8336-cd6d-455f-b80c-2e112109628c tempest-TestStampPattern-2054150877 None] Created volume successfully. Aug 05 15:47:16 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e 1073741824" returned: 0 in 0.691s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:16 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e Aug 05 15:47:16 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:17 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (805c672d-c739-437d-b52c-1a0c8a32c2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0305373-2889-4c70-a711-f70e8b2d37cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:17 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Volume volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e (bbfd067c-0e8a-4122-b1f7-1adc842b7f5e): created successfully Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0305373-2889-4c70-a711-f70e8b2d37cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (d0d0c306-83a9-4456-b19f-9ebf4257f70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-83c61755-af71-42d8-95c5-72dfa9e8626f tempest-ProjectReaderTests-1075061021 None] Created volume successfully. Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-quobyte-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf828b-6aee-4025-abdf-5c7d8a1c7c05]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:18 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e Aug 05 15:47:18 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:18 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e" returned: 0 in 0.438s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:18 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e Aug 05 15:47:18 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:19 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e" returned: 0 in 0.437s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e" released by "delete_volume" :: held 0.936s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Created reservations ['9ed970a5-d704-4033-b336-23daf5b33445', '48af33ea-b77f-4bd1-a47f-db1b8f86bcc6', 'cc78b26a-92c2-4c9a-829b-f917f3a97757', 'a30e60cb-d5ee-44fb-a30b-38d1e596af31'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:19 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:47:19 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:19 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.351s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Deleted volume successfully. Aug 05 15:47:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e0d238ff-fe2f-44eb-85db-a5bb5470c276 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-bbfd067c-0e8a-4122-b1f7-1adc842b7f5e-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (a3fd44e5-a22d-4f97-83b0-ad53289266dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99580f82-97cf-401b-b8b2-09b7b121b5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99580f82-97cf-401b-b8b2-09b7b121b5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398337735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddc97d1-e588-4f5b-9953-728053a9626e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:21Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a018830-78a8-4567-9b00-c8f7cd3723f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a018830-78a8-4567-9b00-c8f7cd3723f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ba526d-c597-4e57-ab5f-8033337d17ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67ba526d-c597-4e57-ab5f-8033337d17ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eddc97d1-e588-4f5b-9953-728053a9626e', 'volume_name': 'volume-eddc97d1-e588-4f5b-9953-728053a9626e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7106d8d5-202b-48e6-9a6c-4e321a8e04f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7106d8d5-202b-48e6-9a6c-4e321a8e04f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236143cf-b75a-4fb2-a681-5e08911ae56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:21 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Volume eddc97d1-e588-4f5b-9953-728053a9626e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eddc97d1-e588-4f5b-9953-728053a9626e', 'volume_size': 1} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398337735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eddc97d1-e588-4f5b-9953-728053a9626e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:21Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Creating volume eddc97d1-e588-4f5b-9953-728053a9626e {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:47:21 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:21 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e 1073741824 Aug 05 15:47:21 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:21 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e 1073741824" returned: 0 in 0.714s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:22 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e Aug 05 15:47:22 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:22 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e" returned: 0 in 0.306s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236143cf-b75a-4fb2-a681-5e08911ae56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eddc97d1-e588-4f5b-9953-728053a9626e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d3e3be-d741-472f-8a6e-5e133ce43d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:22 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Volume volume-eddc97d1-e588-4f5b-9953-728053a9626e (eddc97d1-e588-4f5b-9953-728053a9626e): created successfully Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d3e3be-d741-472f-8a6e-5e133ce43d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (a3fd44e5-a22d-4f97-83b0-ad53289266dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-eb65d5db-ca9e-43b1-b2f8-33f8f1b64135 tempest-ProjectReaderTests-1075061021 None] Created volume successfully. Aug 05 15:47:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-eddc97d1-e588-4f5b-9953-728053a9626e-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-eddc97d1-e588-4f5b-9953-728053a9626e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-quobyte-eddc97d1-e588-4f5b-9953-728053a9626e" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-eddc97d1-e588-4f5b-9953-728053a9626e" acquired by "delete_volume" :: waited 0.037s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bfbe8a-9460-4f3a-b600-8b2c5d38ff24]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:24 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e Aug 05 15:47:24 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:24 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e" returned: 0 in 0.724s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:24 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e Aug 05 15:47:24 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:25 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eddc97d1-e588-4f5b-9953-728053a9626e" returned: 0 in 0.481s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-eddc97d1-e588-4f5b-9953-728053a9626e" released by "delete_volume" :: held 1.307s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Created reservations ['957fc692-bb03-4df1-9817-f14fe514cff7', '1229daab-31b3-4264-911a-63d803df0247', '2d4dbd04-a1b8-4804-93b4-ebe6d9cc4220', '15ce2bf0-3c51-4f5c-8670-4a5c82a6a15a'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:25 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:47:25 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:25 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.439s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Deleted volume successfully. Aug 05 15:47:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-034e3b8d-9a23-410b-86b7-0d6e4a4ce704 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-eddc97d1-e588-4f5b-9953-728053a9626e-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:26 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (ec407955-30eb-4dcb-9ee4-08d9d4a1758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6451e1-412d-4526-9e87-3317c9865704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6451e1-412d-4526-9e87-3317c9865704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637058829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0323c05d-3282-434f-9973-8207156d26a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:27Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a91914-838f-4691-a024-ba8504d37e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a91914-838f-4691-a024-ba8504d37e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6e3700-216d-4706-968b-0cd34ac98ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6e3700-216d-4706-968b-0cd34ac98ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0323c05d-3282-434f-9973-8207156d26a9', 'volume_name': 'volume-0323c05d-3282-434f-9973-8207156d26a9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb4994-35ec-4343-a7ac-d46c515a9614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13cb4994-35ec-4343-a7ac-d46c515a9614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a31d25e-5851-46b9-adda-a81201fff3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Volume 0323c05d-3282-434f-9973-8207156d26a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0323c05d-3282-434f-9973-8207156d26a9', 'volume_size': 1} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637058829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0323c05d-3282-434f-9973-8207156d26a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea637c23a73440493efbc73b2ff6462',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:27Z,use_quota=True,user_id='01aa77ee937648f99ef3a6a30b3b1adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Creating volume 0323c05d-3282-434f-9973-8207156d26a9 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:47:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:27 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 1073741824 Aug 05 15:47:27 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:27 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 1073741824" returned: 0 in 0.627s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:27 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 Aug 05 15:47:27 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:28 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9" returned: 0 in 0.805s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a31d25e-5851-46b9-adda-a81201fff3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0323c05d-3282-434f-9973-8207156d26a9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebd3801-9bfd-4d4f-9a79-bbd8cd0a91ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Volume volume-0323c05d-3282-434f-9973-8207156d26a9 (0323c05d-3282-434f-9973-8207156d26a9): created successfully Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebd3801-9bfd-4d4f-9a79-bbd8cd0a91ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Flow 'volume_create_manager' (ec407955-30eb-4dcb-9ee4-08d9d4a1758d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-64b036a7-f104-4abe-92d8-222f2c04af1f tempest-ProjectReaderTests-1075061021 None] Created volume successfully. Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-0323c05d-3282-434f-9973-8207156d26a9-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-0323c05d-3282-434f-9973-8207156d26a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "cinder-quobyte-0323c05d-3282-434f-9973-8207156d26a9" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-0323c05d-3282-434f-9973-8207156d26a9" acquired by "delete_volume" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203a036-430e-49d0-b11d-d9e226a4752c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:29 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 Aug 05 15:47:29 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:29 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9" returned: 0 in 0.463s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:29 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9 Aug 05 15:47:29 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:30 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0323c05d-3282-434f-9973-8207156d26a9" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-quobyte-0323c05d-3282-434f-9973-8207156d26a9" released by "delete_volume" :: held 0.773s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Created reservations ['4f34207c-843a-4e3e-a40e-07f1b14bd768', '733e6050-8a65-4264-a068-2a29a4830c3d', '2e600129-8ef7-4ccc-abef-280be3452d6e', '1d5a1c48-ea25-45a3-aa5e-479f1deee673'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:30 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:47:30 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:30 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.332s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Deleted volume successfully. Aug 05 15:47:30 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8dac9c7a-0116-4723-aa85-545137f985c3 tempest-ProjectReaderTests-1075061021 None] Lock "cinder-0323c05d-3282-434f-9973-8207156d26a9-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Flow 'volume_create_manager' (43861a2a-d075-4ff2-80f2-80005ed6aa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c37981e-d1dd-4d19-8971-cad89722552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c37981e-d1dd-4d19-8971-cad89722552a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1502725485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293a5977-54fd-432d-8729-53b0104cd94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65001dedfb2c47ee91922066f18247bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:34Z,use_quota=True,user_id='535d7f4c3c52464ab2438e9a56a53882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b845eec2-5f97-412f-8fd9-9536d6e1a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b845eec2-5f97-412f-8fd9-9536d6e1a78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c41624-fcb1-4ece-9c71-44b967f0a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c41624-fcb1-4ece-9c71-44b967f0a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293a5977-54fd-432d-8729-53b0104cd94b', 'volume_name': 'volume-293a5977-54fd-432d-8729-53b0104cd94b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86595b4a-29a8-4608-97ea-5f608519596a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86595b4a-29a8-4608-97ea-5f608519596a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9e82cd-8e12-48fe-8292-0b78eaf87fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Volume 293a5977-54fd-432d-8729-53b0104cd94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293a5977-54fd-432d-8729-53b0104cd94b', 'volume_size': 1} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1502725485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293a5977-54fd-432d-8729-53b0104cd94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65001dedfb2c47ee91922066f18247bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:47:34Z,use_quota=True,user_id='535d7f4c3c52464ab2438e9a56a53882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Creating volume 293a5977-54fd-432d-8729-53b0104cd94b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:47:33 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:47:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:33 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b 1073741824 Aug 05 15:47:33 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:34 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b 1073741824" returned: 0 in 0.540s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:34 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b Aug 05 15:47:34 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:34 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b" returned: 0 in 0.249s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9e82cd-8e12-48fe-8292-0b78eaf87fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293a5977-54fd-432d-8729-53b0104cd94b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e622b328-8109-4436-a564-be95c27cbf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:47:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Volume volume-293a5977-54fd-432d-8729-53b0104cd94b (293a5977-54fd-432d-8729-53b0104cd94b): created successfully Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e622b328-8109-4436-a564-be95c27cbf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:47:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Flow 'volume_create_manager' (43861a2a-d075-4ff2-80f2-80005ed6aa3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:47:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-14660e2c-9708-4882-8969-bdda38e0fd5b tempest-TestMinimumBasicScenario-31512754 None] Created volume successfully. Aug 05 15:47:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-4bf136a1-93a2-44a1-b6b8-506d6f82e9b4 req-423890ae-a7ef-4631-bdbe-d3e2ac540af5 tempest-TestMinimumBasicScenario-31512754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-4bf136a1-93a2-44a1-b6b8-506d6f82e9b4 req-423890ae-a7ef-4631-bdbe-d3e2ac540af5 tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-4bf136a1-93a2-44a1-b6b8-506d6f82e9b4 req-423890ae-a7ef-4631-bdbe-d3e2ac540af5 tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:37 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-4bf136a1-93a2-44a1-b6b8-506d6f82e9b4 req-423890ae-a7ef-4631-bdbe-d3e2ac540af5 tempest-TestMinimumBasicScenario-31512754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-293a5977-54fd-432d-8729-53b0104cd94b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc582a6c-d50b-48aa-ae1d-b52aae62b3a5', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:47:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-4bf136a1-93a2-44a1-b6b8-506d6f82e9b4 req-423890ae-a7ef-4631-bdbe-d3e2ac540af5 tempest-TestMinimumBasicScenario-31512754 None] attachment_update completed successfully. Aug 05 15:47:47 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=27,cinder:INSERT=8,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:47 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=39,cinder:DELETE=5,cinder:SELECT=32,cinder:INSERT=9 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:47:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d9da0433-bae1-4987-8148-d45ca791f1f0 req-7af25d06-cf92-4e99-96d4-0859cb91260f tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d9da0433-bae1-4987-8148-d45ca791f1f0 req-7af25d06-cf92-4e99-96d4-0859cb91260f tempest-TestStampPattern-2054150877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-d9da0433-bae1-4987-8148-d45ca791f1f0 req-7af25d06-cf92-4e99-96d4-0859cb91260f tempest-TestStampPattern-2054150877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-d9da0433-bae1-4987-8148-d45ca791f1f0 req-7af25d06-cf92-4e99-96d4-0859cb91260f tempest-TestStampPattern-2054150877 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-38b61905-d316-4ca8-9bdb-c06b849ede46', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '202ec449-c8d8-4df6-ab83-587c8d4fcc14', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:47:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-d9da0433-bae1-4987-8148-d45ca791f1f0 req-7af25d06-cf92-4e99-96d4-0859cb91260f tempest-TestStampPattern-2054150877 None] attachment_update completed successfully. Aug 05 15:47:50 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-1d02b338-6c84-4370-aadc-bab2e02e8639 req-1c20ab6f-7f84-4f2e-94c9-b9c29a08f1a2 tempest-TestStampPattern-2054150877 None] Terminate volume connection completed successfully. Aug 05 15:47:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-1d02b338-6c84-4370-aadc-bab2e02e8639 req-1c20ab6f-7f84-4f2e-94c9-b9c29a08f1a2 tempest-TestStampPattern-2054150877 None] Deleting attachment 202ec449-c8d8-4df6-ab83-587c8d4fcc14. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:47:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-38b61905-d316-4ca8-9bdb-c06b849ede46-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Lock "cinder-38b61905-d316-4ca8-9bdb-c06b849ede46-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-quobyte-38b61905-d316-4ca8-9bdb-c06b849ede46" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-38b61905-d316-4ca8-9bdb-c06b849ede46" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0efb8f-37b7-491f-9b7c-cd01d117613a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:54 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 Aug 05 15:47:54 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:55 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46" returned: 0 in 0.343s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:55 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46 Aug 05 15:47:55 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:55 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-38b61905-d316-4ca8-9bdb-c06b849ede46" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-38b61905-d316-4ca8-9bdb-c06b849ede46" released by "delete_volume" :: held 0.636s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Created reservations ['06605d4d-f413-423d-b242-ce7dacde7de1', 'a3d8f51f-9794-44b4-ae0a-5e9c46e8e772', '185f3cc7-048f-465d-90b7-9a13a23c1d13', '2857be02-4766-4bc1-a101-6bbd07600b0f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:55 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:47:55 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:55 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.256s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:47:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Deleted volume successfully. Aug 05 15:47:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79623e17-b84c-4b18-a465-8b12db1977ce tempest-TestStampPattern-2054150877 None] Lock "cinder-38b61905-d316-4ca8-9bdb-c06b849ede46-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-32458150-2da9-483e-94b4-2b9bbc8f59a6-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Lock "cinder-32458150-2da9-483e-94b4-2b9bbc8f59a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-quobyte-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-quobyte-32458150-2da9-483e-94b4-2b9bbc8f59a6" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-32458150-2da9-483e-94b4-2b9bbc8f59a6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Deleting offline snapshot 32458150-2da9-483e-94b4-2b9bbc8f59a6 of volume 8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] snapshot_file for this snap is: volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59caf0c-31bd-4602-969c-9a9d829f45cd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:56 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 Aug 05 15:47:56 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:56 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6" returned: 0 in 0.353s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e511ced4-09ab-445a-9bc9-332fd8c59224]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:56 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd Aug 05 15:47:56 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:56 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" returned: 0 in 0.518s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:57 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 Aug 05 15:47:57 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:57 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6" returned: 0 in 0.347s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:47:57 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6 Aug 05 15:47:57 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:47:57 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd.32458150-2da9-483e-94b4-2b9bbc8f59a6" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-32458150-2da9-483e-94b4-2b9bbc8f59a6" released by "_delete_snapshot" :: held 1.566s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" released by "delete_snapshot" :: held 1.588s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Created reservations ['87b4a6d1-0879-4d8a-9443-efc423426283', 'e3d9247b-0ae7-49cf-8b57-2bb5edc6740c', '41b27b52-9f16-4bc9-a8e3-2b303b20f6c1', 'e027a1f3-fa88-49fa-aefc-152c3dee79ee'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:47:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Delete snapshot completed successfully. Aug 05 15:47:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-76af70ce-d591-4d5d-9c05-08d208b54561 tempest-TestStampPattern-2054150877 None] Lock "cinder-32458150-2da9-483e-94b4-2b9bbc8f59a6-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-8329b946-c0a3-4f2c-beca-7668f4ba2ddd-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Lock "cinder-8329b946-c0a3-4f2c-beca-7668f4ba2ddd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Acquiring lock "cinder-quobyte-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2aa64c-6793-41a6-8926-aab5479055e2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:02 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd Aug 05 15:48:02 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:02 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:02 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd Aug 05 15:48:02 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:02 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Lock "cinder-quobyte-8329b946-c0a3-4f2c-beca-7668f4ba2ddd" released by "delete_volume" :: held 0.635s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Created reservations ['7069a255-e065-44cc-bf1e-68714ee7b1c1', '09fc96d6-d224-488c-86d7-15882573fe58', '7d5de59a-269f-4d1a-aac9-44db5fec1a63', '3f4384e7-3292-4420-be99-8298b22787e8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:02 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:02 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:02 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:02 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:02 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Deleted volume successfully. Aug 05 15:48:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2783e694-8c65-4ccb-bff4-761d069abbc9 tempest-TestStampPattern-2054150877 None] Lock "cinder-8329b946-c0a3-4f2c-beca-7668f4ba2ddd-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:10 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:10 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:10 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.259s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:48:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:48:12 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:48:12 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=26,cinder:UPDATE=17,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Flow 'volume_create_manager' (bcf34690-0634-4da3-8943-96f856267c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04630712-9cb4-40ed-ba12-3eb703bddd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04630712-9cb4-40ed-ba12-3eb703bddd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e2db35-4cde-469d-b173-515ddb3bf373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5389f4bb68f446378b42a40581fdb3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:15Z,use_quota=True,user_id='dc70df5540854617809492e25f09b341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d78ab05-5e00-48d0-a194-e7d3c6b87572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d78ab05-5e00-48d0-a194-e7d3c6b87572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f174f0bf-e12f-462b-8d40-afa8e4f35b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f174f0bf-e12f-462b-8d40-afa8e4f35b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e2db35-4cde-469d-b173-515ddb3bf373', 'volume_name': 'volume-15e2db35-4cde-469d-b173-515ddb3bf373', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7850c7b1-a32f-48e1-af92-54dd4032bb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7850c7b1-a32f-48e1-af92-54dd4032bb8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d019a08-05fa-4d82-ba17-2dc5115db7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Volume 15e2db35-4cde-469d-b173-515ddb3bf373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e2db35-4cde-469d-b173-515ddb3bf373', 'volume_size': 1} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e2db35-4cde-469d-b173-515ddb3bf373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5389f4bb68f446378b42a40581fdb3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:15Z,use_quota=True,user_id='dc70df5540854617809492e25f09b341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Creating volume 15e2db35-4cde-469d-b173-515ddb3bf373 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:48:14 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:48:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:14 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 1073741824 Aug 05 15:48:14 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:15 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 1073741824" returned: 0 in 0.426s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:15 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 Aug 05 15:48:15 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:15 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d019a08-05fa-4d82-ba17-2dc5115db7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e2db35-4cde-469d-b173-515ddb3bf373', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53adf3ce-bf44-4422-a52c-cbb2b09f11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:15 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Volume volume-15e2db35-4cde-469d-b173-515ddb3bf373 (15e2db35-4cde-469d-b173-515ddb3bf373): created successfully Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53adf3ce-bf44-4422-a52c-cbb2b09f11a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:15 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Flow 'volume_create_manager' (bcf34690-0634-4da3-8943-96f856267c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-dfb8fc25-87f4-457e-afb5-104bed0f0daa tempest-CinderUnicodeTest-1139960467 None] Created volume successfully. Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Flow 'volume_create_manager' (b76ff4c1-31b8-4163-b32d-a237e624a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5898d7-4f59-43f1-a939-f8e0054e5385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5898d7-4f59-43f1-a939-f8e0054e5385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1099574534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639176fa-c72b-4a9b-a9cc-b230024965ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5389f4bb68f446378b42a40581fdb3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:16Z,use_quota=True,user_id='dc70df5540854617809492e25f09b341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5280dc2c-9b0d-4da1-8b1c-b5c62b626af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5280dc2c-9b0d-4da1-8b1c-b5c62b626af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b1fe4e-2ccc-4c36-872d-dfeecae8bd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b1fe4e-2ccc-4c36-872d-dfeecae8bd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639176fa-c72b-4a9b-a9cc-b230024965ae', 'volume_name': 'volume-639176fa-c72b-4a9b-a9cc-b230024965ae', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6363e4-6104-4bbe-b6a6-ea18065945eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6363e4-6104-4bbe-b6a6-ea18065945eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87fa4a0-ea65-4a10-a317-5723e8ff74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:16 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Volume 639176fa-c72b-4a9b-a9cc-b230024965ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639176fa-c72b-4a9b-a9cc-b230024965ae', 'volume_size': 1} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:16Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1099574534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639176fa-c72b-4a9b-a9cc-b230024965ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5389f4bb68f446378b42a40581fdb3c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:16Z,use_quota=True,user_id='dc70df5540854617809492e25f09b341',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Creating volume 639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:48:16 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:16 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae 1073741824 Aug 05 15:48:16 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:16 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae 1073741824" returned: 0 in 0.404s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:16 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae Aug 05 15:48:16 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:17 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87fa4a0-ea65-4a10-a317-5723e8ff74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639176fa-c72b-4a9b-a9cc-b230024965ae', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58aeca1a-47d2-4d06-89c8-14dacfdcb5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:17 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Volume volume-639176fa-c72b-4a9b-a9cc-b230024965ae (639176fa-c72b-4a9b-a9cc-b230024965ae): created successfully Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58aeca1a-47d2-4d06-89c8-14dacfdcb5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Flow 'volume_create_manager' (b76ff4c1-31b8-4163-b32d-a237e624a287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7a4f27b2-5fd9-4bd9-bb0a-f7e2d7618536 tempest-CinderUnicodeTest-1139960467 None] Created volume successfully. Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Creating offline snapshot b9b28868-a8cf-48b0-9802-906a710b9653 of volume 639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[78400a88-812f-4d32-a35f-fdc94c71d019]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:17 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae Aug 05 15:48:17 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:17 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae" returned: 0 in 0.353s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:17 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 1G Aug 05 15:48:17 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:18 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 1G" returned: 0 in 0.402s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639176fa-c72b-4a9b-a9cc-b230024965ae -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:18 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639176fa-c72b-4a9b-a9cc-b230024965ae -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 Aug 05 15:48:18 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:18 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639176fa-c72b-4a9b-a9cc-b230024965ae -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653" returned: 0 in 0.300s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:18 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 is being set with open permissions: ugo+rw Aug 05 15:48:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:18 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 Aug 05 15:48:18 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:18 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653" returned: 0 in 0.234s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:18 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info Aug 05 15:48:18 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:19 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info" returned: 0 in 0.237s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:19 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info is being set with open permissions: ugo+rw Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:19 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info Aug 05 15:48:19 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:19 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.info" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f0cd49db-2b73-431a-930e-99de8bb16229 tempest-CinderUnicodeTest-1139960467 None] Create snapshot completed successfully Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-b9b28868-a8cf-48b0-9802-906a710b9653-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-b9b28868-a8cf-48b0-9802-906a710b9653-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-quobyte-639176fa-c72b-4a9b-a9cc-b230024965ae" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-639176fa-c72b-4a9b-a9cc-b230024965ae" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-quobyte-b9b28868-a8cf-48b0-9802-906a710b9653" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-b9b28868-a8cf-48b0-9802-906a710b9653" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Deleting offline snapshot b9b28868-a8cf-48b0-9802-906a710b9653 of volume 639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] snapshot_file for this snap is: volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1aa959-6e21-44fc-a152-3196b3c8667c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:19 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 Aug 05 15:48:19 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:20 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653" returned: 0 in 0.386s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-639176fa-c72b-4a9b-a9cc-b230024965ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[137cdf2d-7c57-4b28-b7d3-bc272964fcc7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:20 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae Aug 05 15:48:20 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:20 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae" returned: 0 in 0.370s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:20 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 Aug 05 15:48:20 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:20 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653" returned: 0 in 0.386s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:20 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653 Aug 05 15:48:20 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:21 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae.b9b28868-a8cf-48b0-9802-906a710b9653" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-b9b28868-a8cf-48b0-9802-906a710b9653" released by "_delete_snapshot" :: held 1.524s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-639176fa-c72b-4a9b-a9cc-b230024965ae" released by "delete_snapshot" :: held 1.550s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Created reservations ['69e0ddfe-407f-4e79-beb4-c316696c0082', '33869ada-d4c9-47d8-8e50-4533abbec7fb', '712ff720-cb16-4b84-ba6c-d16d40f1db24', '70f67ff0-f52a-4592-876c-f1267a9ae2b3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Delete snapshot completed successfully. Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-62d781a0-f7b0-4b92-bb66-2afd55ac0cb4 tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-b9b28868-a8cf-48b0-9802-906a710b9653-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-639176fa-c72b-4a9b-a9cc-b230024965ae-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-639176fa-c72b-4a9b-a9cc-b230024965ae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-quobyte-639176fa-c72b-4a9b-a9cc-b230024965ae" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-639176fa-c72b-4a9b-a9cc-b230024965ae" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30f7a1f-7441-4a7c-9787-c5eec80400f9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:22 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae Aug 05 15:48:22 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:22 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae" returned: 0 in 0.383s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:22 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae Aug 05 15:48:22 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:22 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-639176fa-c72b-4a9b-a9cc-b230024965ae" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-639176fa-c72b-4a9b-a9cc-b230024965ae" released by "delete_volume" :: held 0.701s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Created reservations ['65520265-9639-4fc6-8346-e35c78da5714', 'f06902a2-7ab0-40ab-a846-5471b9d2270b', '433e10b9-e34f-44cb-92e7-9b2f310eedb9', '8048a26c-e84f-4db2-ba44-51dc5965059b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:22 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:22 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:22 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.250s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Deleted volume successfully. Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-15e2db35-4cde-469d-b173-515ddb3bf373-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-80cd67ec-8f70-49db-b122-f8d7241c8c6e tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-639176fa-c72b-4a9b-a9cc-b230024965ae-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-15e2db35-4cde-469d-b173-515ddb3bf373-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "cinder-quobyte-15e2db35-4cde-469d-b173-515ddb3bf373" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-15e2db35-4cde-469d-b173-515ddb3bf373" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[665257b3-d7fb-49d0-9a29-e3bea3a2e8f0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:23 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 Aug 05 15:48:23 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:23 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:23 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373 Aug 05 15:48:23 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:23 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-15e2db35-4cde-469d-b173-515ddb3bf373" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-quobyte-15e2db35-4cde-469d-b173-515ddb3bf373" released by "delete_volume" :: held 0.625s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Created reservations ['cb99a267-4f1c-4fe5-9261-66ac2af12642', 'f0470090-14de-4c19-bf1d-4d5b99fcc3b0', 'e7fb7a5b-94d9-48f2-932e-0586af78ee9a', 'c8f48226-c6dd-4557-8e63-41dd26f0dbb8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:23 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:23 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:24 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:24 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:24 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Deleted volume successfully. Aug 05 15:48:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8bc09b3a-d0a6-4ddd-8f5a-ec7e4798f91d tempest-CinderUnicodeTest-1139960467 None] Lock "cinder-15e2db35-4cde-469d-b173-515ddb3bf373-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Flow 'volume_create_manager' (cffbdd86-9a66-4e16-b201-476a7922e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3007ce45-7761-46a0-9cff-5adb015b7579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3007ce45-7761-46a0-9cff-5adb015b7579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65696741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a4a119-0879-45fa-9a55-962774aef632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1d4ef90d1848ac9aeabb2e06177997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:27Z,use_quota=True,user_id='87589187724a4ab9bb1bd72d28b93285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34fbc10-aa86-41c0-af71-e28dc122769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34fbc10-aa86-41c0-af71-e28dc122769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8683cd0c-2307-4089-99be-f833fa7cb43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8683cd0c-2307-4089-99be-f833fa7cb43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a4a119-0879-45fa-9a55-962774aef632', 'volume_name': 'volume-45a4a119-0879-45fa-9a55-962774aef632', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd439074-44a4-4ff2-948c-63699cf9c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd439074-44a4-4ff2-948c-63699cf9c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc436b9-8886-4da9-a5c4-924100c3adaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:27 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Volume 45a4a119-0879-45fa-9a55-962774aef632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a4a119-0879-45fa-9a55-962774aef632', 'volume_size': 1} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-65696741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a4a119-0879-45fa-9a55-962774aef632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1d4ef90d1848ac9aeabb2e06177997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:27Z,use_quota=True,user_id='87589187724a4ab9bb1bd72d28b93285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Creating volume 45a4a119-0879-45fa-9a55-962774aef632 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:48:27 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:27 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 1073741824 Aug 05 15:48:27 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:27 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 1073741824" returned: 0 in 0.445s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:28 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 Aug 05 15:48:28 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:28 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc436b9-8886-4da9-a5c4-924100c3adaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a4a119-0879-45fa-9a55-962774aef632', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbb02ae-fbb5-445e-8c9e-051032317b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Volume volume-45a4a119-0879-45fa-9a55-962774aef632 (45a4a119-0879-45fa-9a55-962774aef632): created successfully Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adbb02ae-fbb5-445e-8c9e-051032317b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Flow 'volume_create_manager' (cffbdd86-9a66-4e16-b201-476a7922e175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f8e3821d-1774-4435-aea6-3b9495ec785b tempest-ProjectReaderTests-1486914227 None] Created volume successfully. Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Acquiring lock "cinder-45a4a119-0879-45fa-9a55-962774aef632-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Lock "cinder-45a4a119-0879-45fa-9a55-962774aef632-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Acquiring lock "cinder-quobyte-45a4a119-0879-45fa-9a55-962774aef632" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Lock "cinder-quobyte-45a4a119-0879-45fa-9a55-962774aef632" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd38b9d-8466-4313-9523-f7abc97b85a3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:28 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 Aug 05 15:48:28 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:29 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632" returned: 0 in 0.358s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:29 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632 Aug 05 15:48:29 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:29 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-45a4a119-0879-45fa-9a55-962774aef632" returned: 0 in 0.243s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Lock "cinder-quobyte-45a4a119-0879-45fa-9a55-962774aef632" released by "delete_volume" :: held 0.640s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Created reservations ['2b56495f-82b8-4976-b3ca-7ebae4f4b482', '05527542-2025-4afb-a31a-fe91c3300049', '7401bf2c-290c-40fc-998d-5cfb65ccf34c', '4c074899-ea96-4775-a5fb-e462bb478342'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:29 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:29 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:29 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Deleted volume successfully. Aug 05 15:48:29 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-906de9b6-c54b-463b-ad24-d0df365aabcb tempest-ProjectReaderTests-1486914227 None] Lock "cinder-45a4a119-0879-45fa-9a55-962774aef632-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Flow 'volume_create_manager' (a7440038-3c44-4b9d-b60a-c3e7301c2cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f275a2-d0d8-4e4f-babd-614156c60874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f275a2-d0d8-4e4f-babd-614156c60874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531875631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ded8ab-fd5f-490e-9667-c4c281211a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1d4ef90d1848ac9aeabb2e06177997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:30Z,use_quota=True,user_id='87589187724a4ab9bb1bd72d28b93285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38062f1e-363d-44c0-b368-fb6f72e8778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38062f1e-363d-44c0-b368-fb6f72e8778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5934dd83-9ca0-47e9-bd5b-ea1bd972f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5934dd83-9ca0-47e9-bd5b-ea1bd972f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ded8ab-fd5f-490e-9667-c4c281211a9a', 'volume_name': 'volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f416fb8-fe1f-4f86-afce-b3cb13a84f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f416fb8-fe1f-4f86-afce-b3cb13a84f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505d1225-44d3-4ed6-b924-bcd050a94533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:30 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Volume e7ded8ab-fd5f-490e-9667-c4c281211a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a', 'volume_size': 1} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531875631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ded8ab-fd5f-490e-9667-c4c281211a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1d4ef90d1848ac9aeabb2e06177997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:48:30Z,use_quota=True,user_id='87589187724a4ab9bb1bd72d28b93285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Creating volume e7ded8ab-fd5f-490e-9667-c4c281211a9a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:48:30 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:30 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a 1073741824 Aug 05 15:48:30 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:30 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a 1073741824" returned: 0 in 0.396s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:30 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a Aug 05 15:48:30 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:30 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a" returned: 0 in 0.239s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505d1225-44d3-4ed6-b924-bcd050a94533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18170ac9-182d-4efe-8ce6-b7d83da67af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:48:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Volume volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a (e7ded8ab-fd5f-490e-9667-c4c281211a9a): created successfully Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18170ac9-182d-4efe-8ce6-b7d83da67af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Flow 'volume_create_manager' (a7440038-3c44-4b9d-b60a-c3e7301c2cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:48:31 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8db1f785-3751-4660-af0e-7146913f6789 tempest-ProjectReaderTests-1486914227 None] Created volume successfully. Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Acquiring lock "cinder-e7ded8ab-fd5f-490e-9667-c4c281211a9a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Lock "cinder-e7ded8ab-fd5f-490e-9667-c4c281211a9a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Acquiring lock "cinder-quobyte-e7ded8ab-fd5f-490e-9667-c4c281211a9a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Lock "cinder-quobyte-e7ded8ab-fd5f-490e-9667-c4c281211a9a" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[51de443e-eaec-4ced-bf19-ac7b6b8f6685]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:31 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a Aug 05 15:48:31 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:31 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a" returned: 0 in 0.338s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:31 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a Aug 05 15:48:31 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:31 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e7ded8ab-fd5f-490e-9667-c4c281211a9a" returned: 0 in 0.229s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Lock "cinder-quobyte-e7ded8ab-fd5f-490e-9667-c4c281211a9a" released by "delete_volume" :: held 0.600s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:31 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Created reservations ['ba83d549-7e2f-4800-aad1-baf11611c6af', '1b9d79f9-4b2b-488f-902a-5b3996a508d8', 'd0d7cade-9032-4e17-93a3-2ce75e0fb2f3', '3276878a-138d-4d98-99e9-5485754d4b9e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:32 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:32 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:32 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.231s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Deleted volume successfully. Aug 05 15:48:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5238f3b5-34d7-48a6-a236-b305de54395e tempest-ProjectReaderTests-1486914227 None] Lock "cinder-e7ded8ab-fd5f-490e-9667-c4c281211a9a-delete_volume" released by "delete_volume" :: held 1.022s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-e25386a7-c7a4-46e2-85a9-4613c8c3d026 req-9c43d76d-e362-473d-afa8-7d25113cbcb5 tempest-TestMinimumBasicScenario-31512754 None] Terminate volume connection completed successfully. Aug 05 15:48:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-e25386a7-c7a4-46e2-85a9-4613c8c3d026 req-9c43d76d-e362-473d-afa8-7d25113cbcb5 tempest-TestMinimumBasicScenario-31512754 None] Deleting attachment dc582a6c-d50b-48aa-ae1d-b52aae62b3a5. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Acquiring lock "cinder-293a5977-54fd-432d-8729-53b0104cd94b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Lock "cinder-293a5977-54fd-432d-8729-53b0104cd94b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Acquiring lock "cinder-quobyte-293a5977-54fd-432d-8729-53b0104cd94b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Lock "cinder-quobyte-293a5977-54fd-432d-8729-53b0104cd94b" acquired by "delete_volume" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d5fdaa-65ed-4a8e-b822-29198701e24f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:39 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b Aug 05 15:48:39 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:39 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:39 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b Aug 05 15:48:39 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:40 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-293a5977-54fd-432d-8729-53b0104cd94b" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Lock "cinder-quobyte-293a5977-54fd-432d-8729-53b0104cd94b" released by "delete_volume" :: held 0.612s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Created reservations ['5a21f2ee-6885-4887-bce2-5d144dcb9dc7', '82beb24e-15bb-4b92-98fd-1ab398bd554d', '9083bb2e-12ee-45e1-803d-bb469dd8d2a1', '37664db3-eb79-4715-8eb8-c7e6f2e37095'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:48:40 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:48:40 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:48:40 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:48:40 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Deleted volume successfully. Aug 05 15:48:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4f68dc-333f-42ea-9516-7f0533a15fa6 tempest-TestMinimumBasicScenario-31512754 None] Lock "cinder-293a5977-54fd-432d-8729-53b0104cd94b-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:48:50 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=56,cinder:SELECT=44,cinder:INSERT=18,cinder:DELETE=6 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:48:50 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=43,cinder:INSERT=11,cinder:UPDATE=63,cinder:DELETE=4 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:10 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:49:10 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:10 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.242s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:49:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Flow 'volume_create_manager' (8d2ff594-b4fb-496e-845d-6c4c4fd239c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cfb73e-3fea-458f-90e5-645bc568df5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cfb73e-3fea-458f-90e5-645bc568df5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1052807062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168dcfb8-c0f3-49fc-a250-243edc3a56e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ea43d8bc7641febc489672d978145c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:42Z,use_quota=True,user_id='9286008b321c430190480444e1abbd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d938a383-ea76-4e6e-9db3-1094132c18e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d938a383-ea76-4e6e-9db3-1094132c18e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e34db50-9c64-4c79-8290-8625b34c2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e34db50-9c64-4c79-8290-8625b34c2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168dcfb8-c0f3-49fc-a250-243edc3a56e0', 'volume_name': 'volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675fff3d-1a35-495c-a46d-08a377a96ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675fff3d-1a35-495c-a46d-08a377a96ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afb15fc-d815-4730-8b20-b32eac822d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:41 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Volume 168dcfb8-c0f3-49fc-a250-243edc3a56e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0', 'volume_size': 1} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1052807062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168dcfb8-c0f3-49fc-a250-243edc3a56e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ea43d8bc7641febc489672d978145c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:49:42Z,use_quota=True,user_id='9286008b321c430190480444e1abbd20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Creating volume 168dcfb8-c0f3-49fc-a250-243edc3a56e0 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:49:41 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:49:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:41 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 1073741824 Aug 05 15:49:41 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:42 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 1073741824" returned: 0 in 0.414s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:42 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 Aug 05 15:49:42 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:42 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0" returned: 0 in 0.245s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afb15fc-d815-4730-8b20-b32eac822d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba2384c-6512-4177-95ed-a02c453d6e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:49:42 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Volume volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 (168dcfb8-c0f3-49fc-a250-243edc3a56e0): created successfully Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ba2384c-6512-4177-95ed-a02c453d6e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:49:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Flow 'volume_create_manager' (8d2ff594-b4fb-496e-845d-6c4c4fd239c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:49:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1cb0d067-9a50-4368-ad67-ae8394b4beb1 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Created volume successfully. Aug 05 15:49:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-c20bfc76-1946-4b41-9920-b6ea45c48a96 req-bb3fd83e-fbbe-42bd-8210-364ee4307c7a tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-c20bfc76-1946-4b41-9920-b6ea45c48a96 req-bb3fd83e-fbbe-42bd-8210-364ee4307c7a tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-c20bfc76-1946-4b41-9920-b6ea45c48a96 req-bb3fd83e-fbbe-42bd-8210-364ee4307c7a tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-c20bfc76-1946-4b41-9920-b6ea45c48a96 req-bb3fd83e-fbbe-42bd-8210-364ee4307c7a tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6187d00-a730-4ea9-8695-ae931872e423', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:49:43 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-c20bfc76-1946-4b41-9920-b6ea45c48a96 req-bb3fd83e-fbbe-42bd-8210-364ee4307c7a tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] attachment_update completed successfully. Aug 05 15:49:46 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-fbc32363-c92f-4379-bc66-fc81cd832149 req-2bdda2b5-19fc-45e0-b4f0-04cb6a0574aa tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Terminate volume connection completed successfully. Aug 05 15:49:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-fbc32363-c92f-4379-bc66-fc81cd832149 req-2bdda2b5-19fc-45e0-b4f0-04cb6a0574aa tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Deleting attachment d6187d00-a730-4ea9-8695-ae931872e423. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Acquiring lock "cinder-168dcfb8-c0f3-49fc-a250-243edc3a56e0-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "cinder-168dcfb8-c0f3-49fc-a250-243edc3a56e0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Acquiring lock "cinder-quobyte-168dcfb8-c0f3-49fc-a250-243edc3a56e0" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "cinder-quobyte-168dcfb8-c0f3-49fc-a250-243edc3a56e0" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5192bc73-4288-466e-af32-98158b7ab27a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:47 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 Aug 05 15:49:47 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:47 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0" returned: 0 in 0.376s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:47 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0 Aug 05 15:49:47 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:48 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-168dcfb8-c0f3-49fc-a250-243edc3a56e0" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "cinder-quobyte-168dcfb8-c0f3-49fc-a250-243edc3a56e0" released by "delete_volume" :: held 0.687s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Created reservations ['cbec8f2e-8323-4164-8cbd-9e1f5d6d4ae2', '8afd1e2c-97f3-482a-b50c-be6218b9312d', '34948e9e-27c8-4c97-aa77-b0e0c8c8eb2d', '66ca7dd4-17f8-4f21-b0e8-6ae528d2851e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:49:48 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:49:48 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:49:48 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.238s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:49:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Deleted volume successfully. Aug 05 15:49:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e88a07a7-78b1-45b9-9fba-e32fed5a9224 tempest-TestServerVolumeAttachScenarioOldVersion-2015124887 None] Lock "cinder-168dcfb8-c0f3-49fc-a250-243edc3a56e0-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:49:58 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:49:58 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:10 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:50:10 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:10 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:50:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Flow 'volume_create_manager' (2eebabc5-3912-4ca0-851f-b587f5cc9140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4208f096-d56b-47ca-9fc8-55130029b664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4208f096-d56b-47ca-9fc8-55130029b664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-125369995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9246ade7-34d5-4fa5-8134-557e60ae9070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b7ce9336b946e496daf0e90db6c10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:20Z,use_quota=True,user_id='d4a5a693af8b46d7b6075b669b612e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54e92a2-14ed-4e4b-8dae-3cdbdde5cf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54e92a2-14ed-4e4b-8dae-3cdbdde5cf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675b7999-1486-4154-9f23-def1c5584b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675b7999-1486-4154-9f23-def1c5584b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9246ade7-34d5-4fa5-8134-557e60ae9070', 'volume_name': 'volume-9246ade7-34d5-4fa5-8134-557e60ae9070', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974cba3d-b721-44bb-bc27-16d3e6152c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974cba3d-b721-44bb-bc27-16d3e6152c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15bbfbd-62ab-4936-b793-3cc2a1356274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:19 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Volume 9246ade7-34d5-4fa5-8134-557e60ae9070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9246ade7-34d5-4fa5-8134-557e60ae9070', 'volume_size': 1} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-125369995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9246ade7-34d5-4fa5-8134-557e60ae9070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b7ce9336b946e496daf0e90db6c10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:20Z,use_quota=True,user_id='d4a5a693af8b46d7b6075b669b612e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Creating volume 9246ade7-34d5-4fa5-8134-557e60ae9070 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:50:19 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:19 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 1073741824 Aug 05 15:50:19 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Flow 'volume_create_manager' (4f901bc8-a869-49c4-97dd-6d44b2605db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062c23a-0a5c-406e-b38b-011e7a26449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e062c23a-0a5c-406e-b38b-011e7a26449c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-547774074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00f1f06-162a-41f1-ae49-953c843e1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b7ce9336b946e496daf0e90db6c10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:20Z,use_quota=True,user_id='d4a5a693af8b46d7b6075b669b612e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d005814f-e9dc-4bd2-9dfc-87656c850770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d005814f-e9dc-4bd2-9dfc-87656c850770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a19fbd-3564-4e6e-a681-8e7b476a71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a19fbd-3564-4e6e-a681-8e7b476a71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00f1f06-162a-41f1-ae49-953c843e1d0a', 'volume_name': 'volume-a00f1f06-162a-41f1-ae49-953c843e1d0a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0922c258-ee07-438b-b038-e904dfd38a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0922c258-ee07-438b-b038-e904dfd38a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cebcc05-417b-4ed1-8856-cfbd042351fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Volume a00f1f06-162a-41f1-ae49-953c843e1d0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00f1f06-162a-41f1-ae49-953c843e1d0a', 'volume_size': 1} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:20 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 1073741824" returned: 0 in 0.518s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:20 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 Aug 05 15:50:20 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:20 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070" returned: 0 in 0.255s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-547774074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00f1f06-162a-41f1-ae49-953c843e1d0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b7ce9336b946e496daf0e90db6c10e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:50:20Z,use_quota=True,user_id='d4a5a693af8b46d7b6075b669b612e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Creating volume a00f1f06-162a-41f1-ae49-953c843e1d0a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:50:20 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15bbfbd-62ab-4936-b793-3cc2a1356274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9246ade7-34d5-4fa5-8134-557e60ae9070', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebedd6a1-ad9b-4edb-9538-a476c7b41960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:20 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a 1073741824 Aug 05 15:50:20 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:20 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Volume volume-9246ade7-34d5-4fa5-8134-557e60ae9070 (9246ade7-34d5-4fa5-8134-557e60ae9070): created successfully Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebedd6a1-ad9b-4edb-9538-a476c7b41960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:20 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Flow 'volume_create_manager' (2eebabc5-3912-4ca0-851f-b587f5cc9140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-78a98435-3460-4b2b-85e4-62a7dd688e5e tempest-TestServerVolumeAttachmentScenario-436860599 None] Created volume successfully. Aug 05 15:50:21 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a 1073741824" returned: 0 in 0.502s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:50:21 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a Aug 05 15:50:21 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:50:21 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cebcc05-417b-4ed1-8856-cfbd042351fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00f1f06-162a-41f1-ae49-953c843e1d0a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58e8625-a3cb-4e0b-ad6e-4772c33f74d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:50:21 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Volume volume-a00f1f06-162a-41f1-ae49-953c843e1d0a (a00f1f06-162a-41f1-ae49-953c843e1d0a): created successfully Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58e8625-a3cb-4e0b-ad6e-4772c33f74d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:50:21 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Flow 'volume_create_manager' (4f901bc8-a869-49c4-97dd-6d44b2605db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:50:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3732c0ee-fe3f-483c-96c9-6d3cf85f3e68 tempest-TestServerVolumeAttachmentScenario-436860599 None] Created volume successfully. Aug 05 15:50:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:DELETE=2,cinder:INSERT=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:50:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:50:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-cf241f23-813f-4992-bfb6-236103912b1f req-1ee8d0f9-7ef3-4813-b61d-aa5cfa0f590c tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-cf241f23-813f-4992-bfb6-236103912b1f req-1ee8d0f9-7ef3-4813-b61d-aa5cfa0f590c tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-cf241f23-813f-4992-bfb6-236103912b1f req-1ee8d0f9-7ef3-4813-b61d-aa5cfa0f590c tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-cf241f23-813f-4992-bfb6-236103912b1f req-1ee8d0f9-7ef3-4813-b61d-aa5cfa0f590c tempest-TestServerVolumeAttachmentScenario-436860599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-9246ade7-34d5-4fa5-8134-557e60ae9070', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5acf621-d4f5-4fbe-9a01-42d2b2547c6f', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:50:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-cf241f23-813f-4992-bfb6-236103912b1f req-1ee8d0f9-7ef3-4813-b61d-aa5cfa0f590c tempest-TestServerVolumeAttachmentScenario-436860599 None] attachment_update completed successfully. Aug 05 15:50:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-735e09f1-67ec-4622-9f10-33dd3a5fe3be req-fa82717e-68d0-4d7a-a6b1-41b03da8c80b tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:50:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-735e09f1-67ec-4622-9f10-33dd3a5fe3be req-fa82717e-68d0-4d7a-a6b1-41b03da8c80b tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:50:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [req-735e09f1-67ec-4622-9f10-33dd3a5fe3be req-fa82717e-68d0-4d7a-a6b1-41b03da8c80b tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:50:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-735e09f1-67ec-4622-9f10-33dd3a5fe3be req-fa82717e-68d0-4d7a-a6b1-41b03da8c80b tempest-TestServerVolumeAttachmentScenario-436860599 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60', 'name': 'volume-a00f1f06-162a-41f1-ae49-953c843e1d0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eef04c37-cae4-49ee-8c96-7f7626b453ed', 'enforce_multipath': True} {{(pid=88999) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 05 15:50:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-735e09f1-67ec-4622-9f10-33dd3a5fe3be req-fa82717e-68d0-4d7a-a6b1-41b03da8c80b tempest-TestServerVolumeAttachmentScenario-436860599 None] attachment_update completed successfully. Aug 05 15:50:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-54102a6c-8b1c-4959-a0bf-53a99af1ae72 req-c31acf69-acf1-411d-9df6-7bf7c4c3b883 tempest-TestServerVolumeAttachmentScenario-436860599 None] Terminate volume connection completed successfully. Aug 05 15:50:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-54102a6c-8b1c-4959-a0bf-53a99af1ae72 req-c31acf69-acf1-411d-9df6-7bf7c4c3b883 tempest-TestServerVolumeAttachmentScenario-436860599 None] Deleting attachment eef04c37-cae4-49ee-8c96-7f7626b453ed. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:50:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [req-199bf3c4-b590-45ba-8d63-a5e053482e52 req-35a9e11b-492f-41b3-b3ca-abe3e2d11f8d tempest-TestServerVolumeAttachmentScenario-436860599 None] Terminate volume connection completed successfully. Aug 05 15:50:58 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [req-199bf3c4-b590-45ba-8d63-a5e053482e52 req-35a9e11b-492f-41b3-b3ca-abe3e2d11f8d tempest-TestServerVolumeAttachmentScenario-436860599 None] Deleting attachment b5acf621-d4f5-4fbe-9a01-42d2b2547c6f. {{(pid=88999) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "cinder-a00f1f06-162a-41f1-ae49-953c843e1d0a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-a00f1f06-162a-41f1-ae49-953c843e1d0a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "cinder-quobyte-a00f1f06-162a-41f1-ae49-953c843e1d0a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-quobyte-a00f1f06-162a-41f1-ae49-953c843e1d0a" acquired by "delete_volume" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c521a62-aa42-483b-b005-3a19d454ddd2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:02 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a Aug 05 15:51:02 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:02 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:02 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a Aug 05 15:51:02 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:03 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a00f1f06-162a-41f1-ae49-953c843e1d0a" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-quobyte-a00f1f06-162a-41f1-ae49-953c843e1d0a" released by "delete_volume" :: held 0.616s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Created reservations ['ec15c440-50d3-4d5a-90c7-671e8ad35929', 'd6a76213-10a8-4dab-856b-c6c94cbcad3d', 'd61de5eb-1016-4c76-8145-ae04075f1cad', 'e2c2105f-d325-42a5-8759-a6e438b555b5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:03 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:51:03 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:03 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Deleted volume successfully. Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e95837c9-e3bd-4f86-bec9-d1ec6edd4c15 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-a00f1f06-162a-41f1-ae49-953c843e1d0a-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "cinder-9246ade7-34d5-4fa5-8134-557e60ae9070-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-9246ade7-34d5-4fa5-8134-557e60ae9070-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "cinder-quobyte-9246ade7-34d5-4fa5-8134-557e60ae9070" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-quobyte-9246ade7-34d5-4fa5-8134-557e60ae9070" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b23047-6f37-4538-8120-e7e2a9996923]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:03 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 Aug 05 15:51:03 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:03 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:03 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070 Aug 05 15:51:03 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:04 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9246ade7-34d5-4fa5-8134-557e60ae9070" returned: 0 in 0.237s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-quobyte-9246ade7-34d5-4fa5-8134-557e60ae9070" released by "delete_volume" :: held 0.617s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Created reservations ['42073c2b-f40f-441d-9ff2-47ce3010c556', '4380dfc3-1419-4cd3-a6fb-3778d450d78c', '0f850fa1-4194-47f8-b687-20cf5194582d', '1715788f-36a4-49f3-9962-95406f420d36'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:04 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:51:04 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:04 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Deleted volume successfully. Aug 05 15:51:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f9797d22-2a2d-4534-9edd-88bb736b5e81 tempest-TestServerVolumeAttachmentScenario-436860599 None] Lock "cinder-9246ade7-34d5-4fa5-8134-557e60ae9070-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:10 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:51:10 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:10 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:51:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:51:14 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:14 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:31 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:51:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Flow 'volume_create_manager' (620f2015-0f5b-4c4e-a7d7-be75e4819192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4179cbd9-24ac-4026-b236-383f301d2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4179cbd9-24ac-4026-b236-383f301d2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-863208515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba489585-89b8-4ec4-9aa1-5e7ac988bb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5419028cd4c24ecc88e0dd9c6172ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:32Z,use_quota=True,user_id='9d6884e1fa8042a4b56b47e44ec06f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4897a84b-5193-4f07-a9d9-443cef7b5d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4897a84b-5193-4f07-a9d9-443cef7b5d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cb4291-7760-4296-9c6e-0ca4c6f1f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44cb4291-7760-4296-9c6e-0ca4c6f1f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba489585-89b8-4ec4-9aa1-5e7ac988bb04', 'volume_name': 'volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45d9f76-3837-460c-923c-abe8c1f319cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45d9f76-3837-460c-923c-abe8c1f319cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d90bfa1-4fde-4e36-8bdc-3fb7bd1af2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Volume ba489585-89b8-4ec4-9aa1-5e7ac988bb04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04', 'volume_size': 1} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-863208515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba489585-89b8-4ec4-9aa1-5e7ac988bb04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5419028cd4c24ecc88e0dd9c6172ff4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:51:32Z,use_quota=True,user_id='9d6884e1fa8042a4b56b47e44ec06f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Creating volume ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:51:32 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:32 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 1073741824 Aug 05 15:51:32 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:32 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 1073741824" returned: 0 in 0.402s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:32 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 Aug 05 15:51:32 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:32 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d90bfa1-4fde-4e36-8bdc-3fb7bd1af2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2657ca-3fac-4b5b-b5bc-8cb1b54fc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:51:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Volume volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 (ba489585-89b8-4ec4-9aa1-5e7ac988bb04): created successfully Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2657ca-3fac-4b5b-b5bc-8cb1b54fc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:51:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Flow 'volume_create_manager' (620f2015-0f5b-4c4e-a7d7-be75e4819192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:51:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-91190628-9d54-419a-ac19-1dad6888b120 tempest-TestImageHashVerification-1659222831 None] Created volume successfully. Aug 05 15:51:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:33 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ac939f-0dec-479f-a7f0-f64fac40fe6f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:33 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 Aug 05 15:51:33 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:34 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" returned: 0 in 0.358s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e647d0cb-0e37-484b-9f52-74d3bdc8ea85]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:34 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 Aug 05 15:51:34 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:34 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" returned: 0 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 /opt/stack/data/cinder/conversion/ba489585-89b8-4ec4-9aa1-5e7ac988bb04.temp_image.2191d30a-0b67-43ca-a61e-ddf6590380c5meiwkr0k.img {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:34 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 /opt/stack/data/cinder/conversion/ba489585-89b8-4ec4-9aa1-5e7ac988bb04.temp_image.2191d30a-0b67-43ca-a61e-ddf6590380c5meiwkr0k.img Aug 05 15:51:34 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:38 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 /opt/stack/data/cinder/conversion/ba489585-89b8-4ec4-9aa1-5e7ac988bb04.temp_image.2191d30a-0b67-43ca-a61e-ddf6590380c5meiwkr0k.img" returned: 0 in 3.801s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:38 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b322855f-9d38-400a-9c41-83746f9f54c4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:38 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 Aug 05 15:51:38 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:38 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" returned: 0 in 0.559s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:38 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04, size 1024.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/conversion/ba489585-89b8-4ec4-9aa1-5e7ac988bb04.temp_image.2191d30a-0b67-43ca-a61e-ddf6590380c5meiwkr0k.img {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:51:38 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Converted 1024.00 MB image at 269.33 MB/s Aug 05 15:51:38 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] 2191d30a-0b67-43ca-a61e-ddf6590380c5 was raw, no need to convert to raw {{(pid=88999) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 05 15:51:48 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:48 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:51:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.197s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Uploaded volume to glance image-id: 2191d30a-0b67-43ca-a61e-ddf6590380c5. {{(pid=88999) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 05 15:51:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2678df8a-216c-4c92-93d9-f36b4537db09 tempest-TestImageHashVerification-1659222831 None] Copy volume to image completed successfully. Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Acquiring lock "cinder-ba489585-89b8-4ec4-9aa1-5e7ac988bb04-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Lock "cinder-ba489585-89b8-4ec4-9aa1-5e7ac988bb04-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Acquiring lock "cinder-quobyte-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Lock "cinder-quobyte-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[545ea3f9-3cd2-4eb0-8a8d-2dc09ad118d4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:59 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 Aug 05 15:51:59 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:59 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" returned: 0 in 0.340s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:59 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04 Aug 05 15:51:59 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:51:59 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Lock "cinder-quobyte-ba489585-89b8-4ec4-9aa1-5e7ac988bb04" released by "delete_volume" :: held 0.616s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Created reservations ['cea9158d-9ede-4cc2-864e-75e85324a12f', '19182e33-bef5-4f17-9494-2a0d2b03c3c4', '9d70a331-24f9-43c7-b48e-4e2c280461fd', '7285be62-f71c-44ed-92a2-e7d498a82650'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:51:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:51:59 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:51:59 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:00 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.242s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:00 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:00 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Deleted volume successfully. Aug 05 15:52:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c70d3926-7cfe-4afa-b63c-5183dd393ca6 tempest-TestImageHashVerification-1659222831 None] Lock "cinder-ba489585-89b8-4ec4-9aa1-5e7ac988bb04-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:09 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:10 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:52:10 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:10 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:52:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Flow 'volume_create_manager' (52a3beb1-2ed0-4788-8736-2265a812f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed57b478-3ecf-402d-923a-da71e831834a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed57b478-3ecf-402d-923a-da71e831834a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11d4412-adde-4131-8966-f2cba8122ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005c88a7414e424088068a9efd86cf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:15Z,use_quota=True,user_id='a4f473d7d37b44618e4698fc389a3273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdf65ca-e980-47ec-828f-a2a60f27a570),volume_type_id=5cdf65ca-e980-47ec-828f-a2a60f27a570)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255e806-3d63-4ff8-b6da-47feb904eb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255e806-3d63-4ff8-b6da-47feb904eb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a10ede-7e21-4699-97c9-6c7170588db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a10ede-7e21-4699-97c9-6c7170588db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e11d4412-adde-4131-8966-f2cba8122ed8', 'volume_name': 'volume-e11d4412-adde-4131-8966-f2cba8122ed8', 'volume_size': 1, 'image_id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/004918a5-7a90-4f79-8869-9a0b3102c140', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44f2c2db0f6eab26fb9b92948dadcd93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '005c88a7414e424088068a9efd86cf00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25d0f3d7f7506ae92c6eedbf636d546fccbdf041241a7c1db9ae2e741ca2f1991c8322f1e76d5e8396d92118566ca0df678281823b9e046911d11f8263d95362', 'id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'created_at': datetime.datetime(2026, 8, 5, 13, 52, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 52, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/004918a5-7a90-4f79-8869-9a0b3102c140/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11797cb4-36b9-4571-82f4-221f3d5d170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11797cb4-36b9-4571-82f4-221f3d5d170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda08ed7-7f81-4aad-9793-bfcbdc497849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Volume e11d4412-adde-4131-8966-f2cba8122ed8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e11d4412-adde-4131-8966-f2cba8122ed8', 'volume_size': 1, 'image_id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/004918a5-7a90-4f79-8869-9a0b3102c140', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44f2c2db0f6eab26fb9b92948dadcd93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '005c88a7414e424088068a9efd86cf00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25d0f3d7f7506ae92c6eedbf636d546fccbdf041241a7c1db9ae2e741ca2f1991c8322f1e76d5e8396d92118566ca0df678281823b9e046911d11f8263d95362', 'id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'created_at': datetime.datetime(2026, 8, 5, 13, 52, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 52, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/004918a5-7a90-4f79-8869-9a0b3102c140/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 15:52:14 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Trying to clone e11d4412-adde-4131-8966-f2cba8122ed8 from image 004918a5-7a90-4f79-8869-9a0b3102c140 at location (None, [{'url': 'file:///opt/stack/data/glance/images/004918a5-7a90-4f79-8869-9a0b3102c140', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:52:15 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Image download 0.00 MB at 0.00 MB/s Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf2c597-3270-4cde-adcb-0bd64d39948d]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:15 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD Aug 05 15:52:15 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:15 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:15 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD Aug 05 15:52:15 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:15 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Temporary image 004918a5-7a90-4f79-8869-9a0b3102c140 is fetched for user a4f473d7d37b44618e4698fc389a3273. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4678143-3109-4656-90e6-e5d0b8356e63]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:15 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD Aug 05 15:52:15 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:16 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:16 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD Aug 05 15:52:16 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:16 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11d4412-adde-4131-8966-f2cba8122ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='005c88a7414e424088068a9efd86cf00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:15Z,use_quota=True,user_id='a4f473d7d37b44618e4698fc389a3273',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdf65ca-e980-47ec-828f-a2a60f27a570),volume_type_id=5cdf65ca-e980-47ec-828f-a2a60f27a570)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Creating volume e11d4412-adde-4131-8966-f2cba8122ed8 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:52:16 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:16 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 1073741824 Aug 05 15:52:16 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:16 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 1073741824" returned: 0 in 0.425s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:16 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 Aug 05 15:52:16 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:17 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8" returned: 0 in 0.253s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Attempting download of 004918a5-7a90-4f79-8869-9a0b3102c140 ((None, [{'url': 'file:///opt/stack/data/glance/images/004918a5-7a90-4f79-8869-9a0b3102c140', 'metadata': {}}])) to volume e11d4412-adde-4131-8966-f2cba8122ed8. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad26e44d-d52d-4fd6-888b-2aea497900f9]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:17 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9 Aug 05 15:52:17 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:17 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:17 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9 Aug 05 15:52:17 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:17 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9" returned: 1 in 0.307s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_004918a5-7a90-4f79-8869-9a0b3102c140_7afupkf9' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7635a56-2e10-462d-a67f-5ac789b7d4bf]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:17 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD Aug 05 15:52:17 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:18 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD" returned: 0 in 0.304s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:18 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD Aug 05 15:52:18 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:18 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD" returned: 1 in 0.302s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] 004918a5-7a90-4f79-8869-9a0b3102c140 was raw, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:18 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 Aug 05 15:52:18 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:18 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8" returned: 0 in 0.411s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_004918a5-7a90-4f79-8869-9a0b3102c140_ws27r78pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:52:18 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 15:52:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:18 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 1G Aug 05 15:52:18 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:19 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 1G" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Downloaded image 004918a5-7a90-4f79-8869-9a0b3102c140 ((None, [{'url': 'file:///opt/stack/data/glance/images/004918a5-7a90-4f79-8869-9a0b3102c140', 'metadata': {}}])) to volume e11d4412-adde-4131-8966-f2cba8122ed8 successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Temporary image 004918a5-7a90-4f79-8869-9a0b3102c140 for user a4f473d7d37b44618e4698fc389a3273 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Marking volume e11d4412-adde-4131-8966-f2cba8122ed8 as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Copying metadata from image 004918a5-7a90-4f79-8869-9a0b3102c140 to e11d4412-adde-4131-8966-f2cba8122ed8. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Creating volume glance metadata for volume e11d4412-adde-4131-8966-f2cba8122ed8 backed by image 004918a5-7a90-4f79-8869-9a0b3102c140 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44f2c2db0f6eab26fb9b92948dadcd93', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda08ed7-7f81-4aad-9793-bfcbdc497849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11d4412-adde-4131-8966-f2cba8122ed8', 'volume_size': 1, 'image_id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/004918a5-7a90-4f79-8869-9a0b3102c140', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44f2c2db0f6eab26fb9b92948dadcd93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '005c88a7414e424088068a9efd86cf00', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25d0f3d7f7506ae92c6eedbf636d546fccbdf041241a7c1db9ae2e741ca2f1991c8322f1e76d5e8396d92118566ca0df678281823b9e046911d11f8263d95362', 'id': '004918a5-7a90-4f79-8869-9a0b3102c140', 'created_at': datetime.datetime(2026, 8, 5, 13, 52, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 52, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/004918a5-7a90-4f79-8869-9a0b3102c140/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c84dac-3b01-4cab-856b-481b07808f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:19 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Volume volume-e11d4412-adde-4131-8966-f2cba8122ed8 (e11d4412-adde-4131-8966-f2cba8122ed8): created successfully Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c84dac-3b01-4cab-856b-481b07808f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Flow 'volume_create_manager' (52a3beb1-2ed0-4788-8736-2265a812f592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a94627c2-1698-4fe4-a7a6-71369f906bb9 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Created volume successfully. Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Acquiring lock "cinder-e11d4412-adde-4131-8966-f2cba8122ed8-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "cinder-e11d4412-adde-4131-8966-f2cba8122ed8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Acquiring lock "cinder-quobyte-e11d4412-adde-4131-8966-f2cba8122ed8" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "cinder-quobyte-e11d4412-adde-4131-8966-f2cba8122ed8" acquired by "delete_volume" :: waited 0.012s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0350e868-178f-408a-ab95-717fca753a6e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:20 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 Aug 05 15:52:20 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:20 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:20 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8 Aug 05 15:52:20 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:20 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e11d4412-adde-4131-8966-f2cba8122ed8" returned: 0 in 0.230s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "cinder-quobyte-e11d4412-adde-4131-8966-f2cba8122ed8" released by "delete_volume" :: held 0.610s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:20 devstack cinder-volume[88999]: WARNING cinder.quota [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:52:20 devstack cinder-volume[88999]: WARNING cinder.quota [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Created reservations ['aaa60b31-e6d9-4c49-a6c9-8866d2ac8201', 'd6dca504-ae10-401b-95e7-08b3a06752fc', 'aea99e5d-8f71-4cfa-aa73-6c3eac1b63eb', '41199db7-a2f0-4c21-8a51-9d80ff72b27f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:20 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:52:20 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:20 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.223s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Deleted volume successfully. Aug 05 15:52:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2dd5ef1a-5a2b-4654-9e3b-512e63dba7f0 tempest-VolumeAndVolumeTypeFromImageTest-1410560356 None] Lock "cinder-e11d4412-adde-4131-8966-f2cba8122ed8-delete_volume" released by "delete_volume" :: held 1.004s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Flow 'volume_create_manager' (6343db79-cd10-47a8-a73c-4f9f5acb1c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966f9669-21f1-4df9-9803-0ed2358eca7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (966f9669-21f1-4df9-9803-0ed2358eca7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-442631129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5c068c-eb6d-437c-a6ca-8db20e03d6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f2de66e6324f03a4af5b6351a8787b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:25Z,use_quota=True,user_id='adb5e73698364a04bbddf97829c0fd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a33272c-456c-4a27-8e65-f3e9ba65b779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a33272c-456c-4a27-8e65-f3e9ba65b779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35fad0-6c54-45ba-adbc-e008756c51ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e35fad0-6c54-45ba-adbc-e008756c51ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5c068c-eb6d-437c-a6ca-8db20e03d6a1', 'volume_name': 'volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594536a5-75b0-4df1-9c13-c44643ba7b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594536a5-75b0-4df1-9c13-c44643ba7b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bf3d86-a78d-42ee-9147-c91c5ea75818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:24 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Volume eb5c068c-eb6d-437c-a6ca-8db20e03d6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1', 'volume_size': 1} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-442631129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5c068c-eb6d-437c-a6ca-8db20e03d6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f2de66e6324f03a4af5b6351a8787b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:25Z,use_quota=True,user_id='adb5e73698364a04bbddf97829c0fd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Creating volume eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:52:24 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:52:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:24 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 1073741824 Aug 05 15:52:25 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:25 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 1073741824" returned: 0 in 0.401s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:25 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 Aug 05 15:52:25 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:25 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" returned: 0 in 0.237s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bf3d86-a78d-42ee-9147-c91c5ea75818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a79e7e5-de04-465c-8bd6-c46baa142946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:25 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Volume volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 (eb5c068c-eb6d-437c-a6ca-8db20e03d6a1): created successfully Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a79e7e5-de04-465c-8bd6-c46baa142946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Flow 'volume_create_manager' (6343db79-cd10-47a8-a73c-4f9f5acb1c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-53d011d4-5e52-47ea-a125-0ef5558e0c05 tempest-VolumeDependencyTests-850260280 None] Created volume successfully. Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Creating offline snapshot e0ff7528-2dc3-42ab-aab1-dfec173b35aa of volume eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e0ad0-0ce2-4892-b647-3a7df9981df5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:26 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 Aug 05 15:52:26 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:26 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" returned: 0 in 0.346s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:26 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa 1G Aug 05 15:52:26 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:26 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa 1G" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:26 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa Aug 05 15:52:26 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:27 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:27 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa is being set with open permissions: ugo+rw Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:27 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa Aug 05 15:52:27 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:27 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:27 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info Aug 05 15:52:27 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:27 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info" returned: 0 in 0.240s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:27 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info is being set with open permissions: ugo+rw Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:27 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info Aug 05 15:52:27 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:27 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.info" returned: 0 in 0.228s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ea1a69f5-d9a4-43aa-be84-049efc9c65a2 tempest-VolumeDependencyTests-850260280 None] Create snapshot completed successfully Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Flow 'volume_create_manager' (fae12c18-6203-41db-8cfc-65d23ea00191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4048c27-92f1-4fc0-a439-7800b249ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4048c27-92f1-4fc0-a439-7800b249ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-685926335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208b11d1-bfce-426e-9418-20e13ec1e075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f2de66e6324f03a4af5b6351a8787b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0ff7528-2dc3-42ab-aab1-dfec173b35aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:29Z,use_quota=True,user_id='adb5e73698364a04bbddf97829c0fd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becf1c03-852b-45dc-8c99-e89e5420d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becf1c03-852b-45dc-8c99-e89e5420d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971d8797-3e31-4e65-af16-a62334f7a3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (971d8797-3e31-4e65-af16-a62334f7a3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '208b11d1-bfce-426e-9418-20e13ec1e075', 'volume_name': 'volume-208b11d1-bfce-426e-9418-20e13ec1e075', 'volume_size': 1, 'snapshot_id': 'e0ff7528-2dc3-42ab-aab1-dfec173b35aa'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fd202b-9560-4e45-a9c3-96a1746af611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fd202b-9560-4e45-a9c3-96a1746af611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc5741-31c6-4df2-b8d5-5ab8a7046bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:28 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Volume 208b11d1-bfce-426e-9418-20e13ec1e075: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-208b11d1-bfce-426e-9418-20e13ec1e075', 'volume_size': 1, 'snapshot_id': 'e0ff7528-2dc3-42ab-aab1-dfec173b35aa'} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-quobyte-e0ff7528-2dc3-42ab-aab1-dfec173b35aa-208b11d1-bfce-426e-9418-20e13ec1e075" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-e0ff7528-2dc3-42ab-aab1-dfec173b35aa-208b11d1-bfce-426e-9418-20e13ec1e075" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Creating volume 208b11d1-bfce-426e-9418-20e13ec1e075 from snapshot e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-quobyte-208b11d1-bfce-426e-9418-20e13ec1e075" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-208b11d1-bfce-426e-9418-20e13ec1e075" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] snapshot: e0ff7528-2dc3-42ab-aab1-dfec173b35aa, volume: 208b11d1-bfce-426e-9418-20e13ec1e075, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[db873205-5746-4eb9-92a8-0f49dd037dc2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:28 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa Aug 05 15:52:28 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:29 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[94805666-d90e-46f2-9d93-1daf7bfd39e7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:29 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 Aug 05 15:52:29 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:29 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:52:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:29 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 Aug 05 15:52:29 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:33 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075" returned: 0 in 3.680s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1, size 1024.00 MB, duration 3.68 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:52:33 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Converted 1024.00 MB image at 278.18 MB/s Aug 05 15:52:33 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 is being set with open permissions: ugo+rw Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:33 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 Aug 05 15:52:33 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:33 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075" returned: 0 in 0.225s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-208b11d1-bfce-426e-9418-20e13ec1e075" released by "_copy_volume_from_snapshot" :: held 4.640s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-e0ff7528-2dc3-42ab-aab1-dfec173b35aa-208b11d1-bfce-426e-9418-20e13ec1e075" released by "_create_volume_from_snapshot" :: held 4.694s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.709s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccc5741-31c6-4df2-b8d5-5ab8a7046bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208b11d1-bfce-426e-9418-20e13ec1e075', 'volume_size': 1, 'snapshot_id': 'e0ff7528-2dc3-42ab-aab1-dfec173b35aa'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea522c42-4281-4258-a9d3-311c5c979a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Volume volume-208b11d1-bfce-426e-9418-20e13ec1e075 (208b11d1-bfce-426e-9418-20e13ec1e075): created successfully Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea522c42-4281-4258-a9d3-311c5c979a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Flow 'volume_create_manager' (fae12c18-6203-41db-8cfc-65d23ea00191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-08d321c8-c9b8-4cf1-9276-85ed2027603d tempest-VolumeDependencyTests-850260280 None] Created volume successfully. Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-e0ff7528-2dc3-42ab-aab1-dfec173b35aa-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-e0ff7528-2dc3-42ab-aab1-dfec173b35aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-quobyte-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-quobyte-e0ff7528-2dc3-42ab-aab1-dfec173b35aa" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-e0ff7528-2dc3-42ab-aab1-dfec173b35aa" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Deleting offline snapshot e0ff7528-2dc3-42ab-aab1-dfec173b35aa of volume eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] snapshot_file for this snap is: volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be9fa56-618d-48fa-b43c-4a6f5527534e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:34 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa Aug 05 15:52:34 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:34 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa" returned: 0 in 0.330s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6102893f-4d3c-4ec1-a430-0eff9618e906]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:34 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 Aug 05 15:52:34 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:35 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" returned: 0 in 0.504s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:35 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa Aug 05 15:52:35 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:35 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa" returned: 0 in 0.311s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:35 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa Aug 05 15:52:35 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:35 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1.e0ff7528-2dc3-42ab-aab1-dfec173b35aa" returned: 0 in 0.228s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-e0ff7528-2dc3-42ab-aab1-dfec173b35aa" released by "_delete_snapshot" :: held 1.462s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" released by "delete_snapshot" :: held 1.483s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Created reservations ['af930839-22a1-4880-838e-0980dea25500', '4b9dd43c-fa56-48f0-8918-ffaed1117473', 'ef40baff-f2e8-4c72-aa90-6b349e450888', 'f550704e-00fa-45da-901f-e5b13cd932b3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:52:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Delete snapshot completed successfully. Aug 05 15:52:35 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-782be670-3603-4fbe-a178-043f22738fb6 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-e0ff7528-2dc3-42ab-aab1-dfec173b35aa-delete_snapshot" released by "delete_snapshot" :: held 1.603s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-quobyte-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" acquired by "delete_volume" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff865d35-68e9-43ec-90a9-c403f2c609e3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:36 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 Aug 05 15:52:36 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:36 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:36 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1 Aug 05 15:52:36 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:36 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" returned: 0 in 0.228s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1" released by "delete_volume" :: held 0.611s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:36 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Created reservations ['2182584f-59ac-4790-876a-6a8b1bc60abb', '7a022f5b-c437-4903-a060-15c8a9c2afb8', '7e456bbd-679e-462c-85ee-25e68477305a', '84a8728e-3ac5-433c-a317-a152807695dd'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:37 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:52:37 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:37 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Deleted volume successfully. Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7a1e6fa3-8351-41bb-80ea-deed0a871336 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-eb5c068c-eb6d-437c-a6ca-8db20e03d6a1-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-208b11d1-bfce-426e-9418-20e13ec1e075-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-208b11d1-bfce-426e-9418-20e13ec1e075-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "cinder-quobyte-208b11d1-bfce-426e-9418-20e13ec1e075" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-208b11d1-bfce-426e-9418-20e13ec1e075" acquired by "delete_volume" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eeae436-0474-463e-83d1-fefdb5f0141a]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:37 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 Aug 05 15:52:37 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:37 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:37 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075 Aug 05 15:52:37 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:38 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-208b11d1-bfce-426e-9418-20e13ec1e075" returned: 0 in 0.230s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-quobyte-208b11d1-bfce-426e-9418-20e13ec1e075" released by "delete_volume" :: held 0.602s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Created reservations ['fbddb0c9-b686-4990-9574-9b2f9143b4c8', '9add9a2c-e6eb-40c3-b4cd-c308fccefc9b', '0bd2e794-e651-4a9c-882a-22d8aa4ecde4', '4ac799b1-8943-42d3-8bba-c879c70a90a5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:38 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:52:38 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:38 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.224s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Deleted volume successfully. Aug 05 15:52:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d423cfae-1ee2-4aa2-bacc-e1c464f2c279 tempest-VolumeDependencyTests-850260280 None] Lock "cinder-208b11d1-bfce-426e-9418-20e13ec1e075-delete_volume" released by "delete_volume" :: held 1.003s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Flow 'volume_create_manager' (4c4dc35b-c5d2-4327-bbf9-db263f79864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546d7ce-80f7-4c8c-be1b-863cc8598ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5546d7ce-80f7-4c8c-be1b-863cc8598ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59230b437614023a5c90f34a5285320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:43Z,use_quota=True,user_id='665216be3a454a0c99acecc843f0c7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da45117c-b8ff-440d-be94-b92063be6c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da45117c-b8ff-440d-be94-b92063be6c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe01366a-8688-4d5d-9b39-8866eccf60c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe01366a-8688-4d5d-9b39-8866eccf60c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9', 'volume_name': 'volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9', 'volume_size': 1, 'image_id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f588a7bb-4f58-4cb5-b16b-99d43af72777', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0a74859b3ce352bbfef92d70b6ea912', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e59230b437614023a5c90f34a5285320', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'baf52b10c35932de0a545f379c87322693e886573f305670e56946a058734d0ae8008c70df35a64dfb956e465e5af99d556e5e43c4750ee35d2ea523d68e6641', 'id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'created_at': datetime.datetime(2026, 8, 5, 13, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f588a7bb-4f58-4cb5-b16b-99d43af72777/file', 'properties': {}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85627154-b9e4-43dc-9dbe-f766868c0294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85627154-b9e4-43dc-9dbe-f766868c0294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1af8d19-bd92-451f-8a41-f280c754ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:43 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Volume f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9', 'volume_size': 1, 'image_id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f588a7bb-4f58-4cb5-b16b-99d43af72777', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0a74859b3ce352bbfef92d70b6ea912', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e59230b437614023a5c90f34a5285320', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'baf52b10c35932de0a545f379c87322693e886573f305670e56946a058734d0ae8008c70df35a64dfb956e465e5af99d556e5e43c4750ee35d2ea523d68e6641', 'id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'created_at': datetime.datetime(2026, 8, 5, 13, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f588a7bb-4f58-4cb5-b16b-99d43af72777/file', 'properties': {}}, 'image_service': } Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Trying to clone f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 from image f588a7bb-4f58-4cb5-b16b-99d43af72777 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f588a7bb-4f58-4cb5-b16b-99d43af72777', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:52:43 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Image download 0.00 MB at 0.00 MB/s Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab6cb96-d4cc-4351-9ef8-f6cc440d088f]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:43 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD Aug 05 15:52:43 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:44 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD" returned: 0 in 0.306s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:44 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD Aug 05 15:52:44 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:44 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD" returned: 1 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Temporary image f588a7bb-4f58-4cb5-b16b-99d43af72777 is fetched for user 665216be3a454a0c99acecc843f0c7b3. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf60819-d693-4e8c-9061-2b24f0439a1d]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:44 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD Aug 05 15:52:44 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:44 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:44 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD Aug 05 15:52:44 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:45 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD" returned: 1 in 0.308s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e59230b437614023a5c90f34a5285320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:52:43Z,use_quota=True,user_id='665216be3a454a0c99acecc843f0c7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Creating volume f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:52:45 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:45 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 1073741824 Aug 05 15:52:45 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:45 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 1073741824" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:45 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 Aug 05 15:52:45 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:45 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" returned: 0 in 0.228s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Attempting download of f588a7bb-4f58-4cb5-b16b-99d43af72777 ((None, [{'url': 'file:///opt/stack/data/glance/images/f588a7bb-4f58-4cb5-b16b-99d43af72777', 'metadata': {}}])) to volume f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[672048d1-1a12-41a0-8265-7563f9c8e0cf]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:45 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t Aug 05 15:52:45 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:46 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t" returned: 0 in 0.310s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:46 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t Aug 05 15:52:46 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:46 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t" returned: 1 in 0.307s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f588a7bb-4f58-4cb5-b16b-99d43af72777_kxxgg72t' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ac6f7-f553-4cb6-bdd2-78755266da0f]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:46 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD Aug 05 15:52:46 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:46 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:46 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD Aug 05 15:52:46 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:46 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD" returned: 1 in 0.304s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:52:46 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] f588a7bb-4f58-4cb5-b16b-99d43af72777 was raw, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:47 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 Aug 05 15:52:47 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:47 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" returned: 0 in 0.396s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f588a7bb-4f58-4cb5-b16b-99d43af72777_17r0qy7sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:52:47 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:47 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 1G Aug 05 15:52:47 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:47 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 1G" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Downloaded image f588a7bb-4f58-4cb5-b16b-99d43af72777 ((None, [{'url': 'file:///opt/stack/data/glance/images/f588a7bb-4f58-4cb5-b16b-99d43af72777', 'metadata': {}}])) to volume f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Temporary image f588a7bb-4f58-4cb5-b16b-99d43af72777 for user 665216be3a454a0c99acecc843f0c7b3 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Marking volume f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Copying metadata from image f588a7bb-4f58-4cb5-b16b-99d43af72777 to f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Creating volume glance metadata for volume f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 backed by image f588a7bb-4f58-4cb5-b16b-99d43af72777 with: {'image_id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b0a74859b3ce352bbfef92d70b6ea912', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1af8d19-bd92-451f-8a41-f280c754ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9', 'volume_size': 1, 'image_id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f588a7bb-4f58-4cb5-b16b-99d43af72777', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b0a74859b3ce352bbfef92d70b6ea912', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e59230b437614023a5c90f34a5285320', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'baf52b10c35932de0a545f379c87322693e886573f305670e56946a058734d0ae8008c70df35a64dfb956e465e5af99d556e5e43c4750ee35d2ea523d68e6641', 'id': 'f588a7bb-4f58-4cb5-b16b-99d43af72777', 'created_at': datetime.datetime(2026, 8, 5, 13, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f588a7bb-4f58-4cb5-b16b-99d43af72777/file', 'properties': {}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1cdda6-413c-4577-8560-3d0b59658f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:52:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Volume volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 (f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9): created successfully Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1cdda6-413c-4577-8560-3d0b59658f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:52:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Flow 'volume_create_manager' (4c4dc35b-c5d2-4327-bbf9-db263f79864e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:52:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cc86a1cf-6b57-4736-9d23-85b4b0aba8a3 tempest-VolumeImageDependencyTests-461997036 None] Created volume successfully. Aug 05 15:52:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Acquiring lock "cinder-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Lock "cinder-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Acquiring lock "cinder-quobyte-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:52:48 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Lock "cinder-quobyte-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" acquired by "delete_volume" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:52:48 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ebb2ea-2c61-4b6f-8203-29ae4ad2167f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:52:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:49 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 Aug 05 15:52:49 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:49 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:49 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9 Aug 05 15:52:49 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:49 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" returned: 0 in 0.230s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Lock "cinder-quobyte-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9" released by "delete_volume" :: held 0.611s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Created reservations ['7b48a73f-7cb7-4595-8bfa-0eba3378f7a7', 'c129f0cf-feea-4856-ba92-328779f1319c', 'cfb15599-ba8a-4734-8d4d-7aa65adffe79', '2d6fb1b3-76a2-456e-9057-cffda857f4b5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:52:49 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:52:49 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:52:49 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.234s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:52:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Deleted volume successfully. Aug 05 15:52:49 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7fba9f8-9894-40d0-a98e-7d2061ebe554 tempest-VolumeImageDependencyTests-461997036 None] Lock "cinder-f8cce667-d5f2-4bb3-829c-d4d7a8e5cae9-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:52:59 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=41,cinder:UPDATE=59,cinder:INSERT=25,cinder:DELETE=4 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:52:59 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=60,cinder:UPDATE=50,cinder:INSERT=19,cinder:DELETE=5 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Flow 'volume_create_manager' (2b5edf83-0c16-40d4-8d0b-c7588a52e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78ddfa6-e806-4b6d-ad51-ecd93861c6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78ddfa6-e806-4b6d-ad51-ecd93861c6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2059256113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d216b7a-13d9-4eca-b1a9-39c6c1ac1497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad227ad138cc46bdbac890bc1ca40fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:10Z,use_quota=True,user_id='acdd51b61d5b4f36ac95935c7fcf0ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a34e498-f99e-480a-a0cb-6fcd3ad740fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a34e498-f99e-480a-a0cb-6fcd3ad740fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48846d7-a353-4929-93da-c4e9fb050034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a48846d7-a353-4929-93da-c4e9fb050034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d216b7a-13d9-4eca-b1a9-39c6c1ac1497', 'volume_name': 'volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ae4521-7d9b-4347-ae39-4c174245cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ae4521-7d9b-4347-ae39-4c174245cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b5b2d4-c0cb-4ef0-a082-19e30c199566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:09 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Volume 0d216b7a-13d9-4eca-b1a9-39c6c1ac1497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497', 'volume_size': 1} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2059256113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d216b7a-13d9-4eca-b1a9-39c6c1ac1497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad227ad138cc46bdbac890bc1ca40fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:10Z,use_quota=True,user_id='acdd51b61d5b4f36ac95935c7fcf0ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Creating volume 0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:09 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:09 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 1073741824 Aug 05 15:53:09 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:10 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:10 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:10 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 1073741824" returned: 0 in 0.427s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:10 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 Aug 05 15:53:10 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:10 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:53:10 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9b5b2d4-c0cb-4ef0-a082-19e30c199566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d835cd-6192-4359-9f42-2a54798e67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Volume volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 (0d216b7a-13d9-4eca-b1a9-39c6c1ac1497): created successfully Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d835cd-6192-4359-9f42-2a54798e67c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Flow 'volume_create_manager' (2b5edf83-0c16-40d4-8d0b-c7588a52e207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-25ed8f0d-eb79-4017-854e-9bea40312d7b tempest-SnapshotDependencyTests-2118001445 None] Created volume successfully. Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Creating offline snapshot b48f8f86-89de-4164-9e39-89c0f12b0a58 of volume 0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:53:11 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b792678-0714-450f-bbd2-e4c0930e1628]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:11 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 Aug 05 15:53:11 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:11 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" returned: 0 in 0.356s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:11 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 1G Aug 05 15:53:11 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:11 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 1G" returned: 0 in 0.377s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:11 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 Aug 05 15:53:11 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:12 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58" returned: 0 in 0.282s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:12 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 is being set with open permissions: ugo+rw Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:12 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 Aug 05 15:53:12 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:12 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:12 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info Aug 05 15:53:12 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:12 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:12 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info is being set with open permissions: ugo+rw Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:12 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info Aug 05 15:53:12 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:12 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.info" returned: 0 in 0.229s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:12 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7bfbfd34-93d4-46d7-a519-991575973615 tempest-SnapshotDependencyTests-2118001445 None] Create snapshot completed successfully Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Flow 'volume_create_manager' (24c025e5-b8cf-47cc-a642-4cb6c3f8d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c18db51-4194-4557-b48e-c0cbf2f036d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c18db51-4194-4557-b48e-c0cbf2f036d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1850b04-7543-423f-8df1-1adaa04e964e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad227ad138cc46bdbac890bc1ca40fad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b48f8f86-89de-4164-9e39-89c0f12b0a58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:14Z,use_quota=True,user_id='acdd51b61d5b4f36ac95935c7fcf0ffb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc87a2c3-82c1-4929-87c9-5ddbc1fac538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc87a2c3-82c1-4929-87c9-5ddbc1fac538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f145b403-229b-4a06-b66f-e8eab970bdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f145b403-229b-4a06-b66f-e8eab970bdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1850b04-7543-423f-8df1-1adaa04e964e', 'volume_name': 'volume-e1850b04-7543-423f-8df1-1adaa04e964e', 'volume_size': 1, 'snapshot_id': 'b48f8f86-89de-4164-9e39-89c0f12b0a58'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094e12df-a7c6-46aa-a3b2-00bb961ade1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094e12df-a7c6-46aa-a3b2-00bb961ade1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d90436-9ac3-45ef-9c00-cdb114c07931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Volume e1850b04-7543-423f-8df1-1adaa04e964e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1850b04-7543-423f-8df1-1adaa04e964e', 'volume_size': 1, 'snapshot_id': 'b48f8f86-89de-4164-9e39-89c0f12b0a58'} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-quobyte-b48f8f86-89de-4164-9e39-89c0f12b0a58-e1850b04-7543-423f-8df1-1adaa04e964e" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-b48f8f86-89de-4164-9e39-89c0f12b0a58-e1850b04-7543-423f-8df1-1adaa04e964e" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Creating volume e1850b04-7543-423f-8df1-1adaa04e964e from snapshot b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-quobyte-e1850b04-7543-423f-8df1-1adaa04e964e" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-e1850b04-7543-423f-8df1-1adaa04e964e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] snapshot: b48f8f86-89de-4164-9e39-89c0f12b0a58, volume: e1850b04-7543-423f-8df1-1adaa04e964e, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[30414d31-0017-4772-8072-052f4dac13f8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:13 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 Aug 05 15:53:13 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:14 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58" returned: 0 in 0.350s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[99758016-5fcc-4c8b-aabd-7d495ce978fe]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:14 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 Aug 05 15:53:14 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:14 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" returned: 0 in 0.341s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:53:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:14 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e Aug 05 15:53:14 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:18 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e" returned: 0 in 4.068s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:53:18 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Converted 1024.00 MB image at 251.62 MB/s Aug 05 15:53:18 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e is being set with open permissions: ugo+rw Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:18 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e Aug 05 15:53:18 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:18 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e" returned: 0 in 0.231s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-e1850b04-7543-423f-8df1-1adaa04e964e" released by "_copy_volume_from_snapshot" :: held 5.065s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-b48f8f86-89de-4164-9e39-89c0f12b0a58-e1850b04-7543-423f-8df1-1adaa04e964e" released by "_create_volume_from_snapshot" :: held 5.124s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.137s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d90436-9ac3-45ef-9c00-cdb114c07931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1850b04-7543-423f-8df1-1adaa04e964e', 'volume_size': 1, 'snapshot_id': 'b48f8f86-89de-4164-9e39-89c0f12b0a58'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef7ce17-d086-4ee8-8b19-b48d7a76a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:18 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Volume volume-e1850b04-7543-423f-8df1-1adaa04e964e (e1850b04-7543-423f-8df1-1adaa04e964e): created successfully Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef7ce17-d086-4ee8-8b19-b48d7a76a490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Flow 'volume_create_manager' (24c025e5-b8cf-47cc-a642-4cb6c3f8d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cf403660-5c1b-4541-8eda-fe7d869dbbee tempest-SnapshotDependencyTests-2118001445 None] Created volume successfully. Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-b48f8f86-89de-4164-9e39-89c0f12b0a58-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-b48f8f86-89de-4164-9e39-89c0f12b0a58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-quobyte-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-quobyte-b48f8f86-89de-4164-9e39-89c0f12b0a58" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-b48f8f86-89de-4164-9e39-89c0f12b0a58" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Deleting offline snapshot b48f8f86-89de-4164-9e39-89c0f12b0a58 of volume 0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] snapshot_file for this snap is: volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5664e4-331e-4097-816d-f89a85ce2c44]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:19 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 Aug 05 15:53:19 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:19 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[27418d94-e048-4a39-9175-8a38cbdf01d7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:19 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 Aug 05 15:53:19 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:20 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" returned: 0 in 0.513s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:20 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 Aug 05 15:53:20 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:20 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:20 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58 Aug 05 15:53:20 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:20 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497.b48f8f86-89de-4164-9e39-89c0f12b0a58" returned: 0 in 0.227s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-b48f8f86-89de-4164-9e39-89c0f12b0a58" released by "_delete_snapshot" :: held 1.499s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" released by "delete_snapshot" :: held 1.518s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Created reservations ['b2f11021-77e1-4073-9180-49cd7c1710a4', 'cbbd1329-7a95-4486-a009-087ab358680f', '588564bb-1f36-4226-ba93-c1afa262bdf7', '7dbbb818-f897-4273-ba93-a79285083124'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Delete snapshot completed successfully. Aug 05 15:53:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ff667ce3-fec8-4b56-a503-f7aa855dae8e tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-b48f8f86-89de-4164-9e39-89c0f12b0a58-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-quobyte-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7813c16-8308-415d-86ce-a35341f599a2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:21 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 Aug 05 15:53:21 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:21 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" returned: 0 in 0.345s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:21 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497 Aug 05 15:53:21 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:21 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" returned: 0 in 0.232s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497" released by "delete_volume" :: held 0.645s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Created reservations ['47ab53bb-bd21-42a3-a2fc-51fe43be705f', '0f63f658-119e-477b-ad25-79b45137c838', '7021f454-5dde-4c9e-bef6-6613edf9a8ee', '5aaeaffa-7247-480e-830c-933c21a4309b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:22 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:22 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:22 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.234s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Deleted volume successfully. Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d310577b-4070-49b5-8ecc-6b3cb4e994fb tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-0d216b7a-13d9-4eca-b1a9-39c6c1ac1497-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-e1850b04-7543-423f-8df1-1adaa04e964e-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-e1850b04-7543-423f-8df1-1adaa04e964e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "cinder-quobyte-e1850b04-7543-423f-8df1-1adaa04e964e" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-e1850b04-7543-423f-8df1-1adaa04e964e" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6846e3c-27c1-48c6-b711-4a01dce473c2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:22 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e Aug 05 15:53:22 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:22 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e" returned: 0 in 0.334s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:22 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e Aug 05 15:53:22 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:23 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-e1850b04-7543-423f-8df1-1adaa04e964e" returned: 0 in 0.224s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-quobyte-e1850b04-7543-423f-8df1-1adaa04e964e" released by "delete_volume" :: held 0.595s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Created reservations ['5d91505a-ef13-4147-ba24-a80f8480040a', 'c8dc04c1-6202-4817-be7a-de44b06a8829', '0ed0ea63-8565-488f-b938-fcfd2bf47053', '5f23785b-84c6-4cf7-987e-3fe2f262bdc8'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:23 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:23 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:23 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Deleted volume successfully. Aug 05 15:53:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-afed8ec9-d8c4-42d5-807c-6ad70ca3bd6f tempest-SnapshotDependencyTests-2118001445 None] Lock "cinder-e1850b04-7543-423f-8df1-1adaa04e964e-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:33 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:DELETE=1,cinder:INSERT=4 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:53:33 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=11,cinder:DELETE=4 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (87e31d21-00b1-4cd5-b0c0-6da7cbe0c41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b051d9-e32f-463f-a339-b0515c7eeb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b051d9-e32f-463f-a339-b0515c7eeb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-955278899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f752355-1f73-41a9-b3b5-a3df11e52536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:43Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7455731d-9c96-42a8-b7b7-bcc83199b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7455731d-9c96-42a8-b7b7-bcc83199b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5d1b1-96aa-4cb1-89cd-b499373f1bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5d1b1-96aa-4cb1-89cd-b499373f1bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f752355-1f73-41a9-b3b5-a3df11e52536', 'volume_name': 'volume-2f752355-1f73-41a9-b3b5-a3df11e52536', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:42 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77dee11-8f0d-4ed0-84ca-c6a0e1963e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77dee11-8f0d-4ed0-84ca-c6a0e1963e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6a01fb-c1e7-4ac7-b3a0-4d47a47156e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:43 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume 2f752355-1f73-41a9-b3b5-a3df11e52536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f752355-1f73-41a9-b3b5-a3df11e52536', 'volume_size': 1} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-955278899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f752355-1f73-41a9-b3b5-a3df11e52536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:43Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Creating volume 2f752355-1f73-41a9-b3b5-a3df11e52536 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:43 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:43 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 1073741824 Aug 05 15:53:43 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:43 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 1073741824" returned: 0 in 0.622s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:43 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 Aug 05 15:53:43 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:44 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536" returned: 0 in 0.377s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d6a01fb-c1e7-4ac7-b3a0-4d47a47156e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f752355-1f73-41a9-b3b5-a3df11e52536', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59191713-65e1-4c62-9b01-9cfa2a6c37de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:44 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume volume-2f752355-1f73-41a9-b3b5-a3df11e52536 (2f752355-1f73-41a9-b3b5-a3df11e52536): created successfully Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59191713-65e1-4c62-9b01-9cfa2a6c37de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (87e31d21-00b1-4cd5-b0c0-6da7cbe0c41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-346a54d3-879a-452f-85dc-cfb36d8d39d8 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created volume successfully. Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (1333cc34-dbbd-4dae-95d6-afd0532ee901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69d238c-037e-4285-ab5c-efdc27e8ad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69d238c-037e-4285-ab5c-efdc27e8ad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2086155086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1332cc26-1f33-4820-83ff-7ce169499c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:46Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c96b69-ce0d-4f01-bf6e-aa96bf25876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50c96b69-ce0d-4f01-bf6e-aa96bf25876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad19001-619a-41d9-8ae9-9430cba8f3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad19001-619a-41d9-8ae9-9430cba8f3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1332cc26-1f33-4820-83ff-7ce169499c24', 'volume_name': 'volume-1332cc26-1f33-4820-83ff-7ce169499c24', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af64da7e-f241-43fa-a1f3-c82c9d32e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af64da7e-f241-43fa-a1f3-c82c9d32e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4146e7f-d7ac-4dba-85d5-9f9fb7d56e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:45 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume 1332cc26-1f33-4820-83ff-7ce169499c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1332cc26-1f33-4820-83ff-7ce169499c24', 'volume_size': 1} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2086155086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1332cc26-1f33-4820-83ff-7ce169499c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:46Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Creating volume 1332cc26-1f33-4820-83ff-7ce169499c24 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:45 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:45 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 1073741824 Aug 05 15:53:45 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (977872e4-028a-42d4-b070-b1eea702f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af50ac6d-1f92-4777-aa47-5904dc2d5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af50ac6d-1f92-4777-aa47-5904dc2d5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-683060333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80f843e-b502-40cc-84b9-6ea5409c295a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:46Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4d1c64-d89a-4429-8d9d-87b45c9fefcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4d1c64-d89a-4429-8d9d-87b45c9fefcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08787aa4-3efa-4414-a230-1320dbe7db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08787aa4-3efa-4414-a230-1320dbe7db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80f843e-b502-40cc-84b9-6ea5409c295a', 'volume_name': 'volume-b80f843e-b502-40cc-84b9-6ea5409c295a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b73d34-94ed-487a-9153-1fe4b130933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b73d34-94ed-487a-9153-1fe4b130933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246fe239-1748-411b-bc69-95ac65ae23f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:46 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume b80f843e-b502-40cc-84b9-6ea5409c295a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80f843e-b502-40cc-84b9-6ea5409c295a', 'volume_size': 1} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:46 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 1073741824" returned: 0 in 0.982s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:46 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 Aug 05 15:53:46 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Flow 'volume_create_manager' (89f11271-56e4-465c-afee-2fe2f4540c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79da76ac-67c4-45f5-bc81-778dcc0a6508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79da76ac-67c4-45f5-bc81-778dcc0a6508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff03183d-2472-4a1b-8b40-b8e89ff5c9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d2fe6a1388c4adba61c483b6178a1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:47Z,use_quota=True,user_id='cd7ed389b57c4d84bdd1db604d8edbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e06f057-d7eb-4b24-b060-de7aa0bdb126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e06f057-d7eb-4b24-b060-de7aa0bdb126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327340c8-853f-48c4-bf86-35548ef8ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:53:47 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] <== create_volume: return (1407ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-683060333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80f843e-b502-40cc-84b9-6ea5409c295a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:46Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Creating volume b80f843e-b502-40cc-84b9-6ea5409c295a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:47 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:47 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a 1073741824 Aug 05 15:53:47 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4146e7f-d7ac-4dba-85d5-9f9fb7d56e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1332cc26-1f33-4820-83ff-7ce169499c24', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e93fe7d-8539-4770-9ec7-6a49faa492d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (57e6b8b2-02a4-4da0-a288-7267163137f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38084978-7690-475c-9bb9-2617980698d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume volume-1332cc26-1f33-4820-83ff-7ce169499c24 (1332cc26-1f33-4820-83ff-7ce169499c24): created successfully Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e93fe7d-8539-4770-9ec7-6a49faa492d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (1333cc34-dbbd-4dae-95d6-afd0532ee901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (357c6fce-83a6-45b0-974a-e455b79c5853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527387c4-e4a8-4578-9736-8c9b58dd27d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38084978-7690-475c-9bb9-2617980698d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971492335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7c8def-c27a-40ac-8932-f5e00ec1c157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:47Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f44567-668f-4f1e-acb4-164fbab35b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0f44567-668f-4f1e-acb4-164fbab35b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1968a2e0-6f7f-4d5a-b576-7f27108e9cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1968a2e0-6f7f-4d5a-b576-7f27108e9cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc7c8def-c27a-40ac-8932-f5e00ec1c157', 'volume_name': 'volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7711e38-8f08-471e-bbcc-31586d041290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7711e38-8f08-471e-bbcc-31586d041290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02579b5c-5a3a-4093-b14d-c8b3cbedc1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume cc7c8def-c27a-40ac-8932-f5e00ec1c157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157', 'volume_size': 1} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d9770d8f-e73b-4c84-8b94-79caba200dcf tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created volume successfully. Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527387c4-e4a8-4578-9736-8c9b58dd27d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918396358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a16f0c-edfd-4e27-883d-0d8ce5882189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:47Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef38fc1-edba-4867-9e6b-3355b20d2a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef38fc1-edba-4867-9e6b-3355b20d2a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa484838-d857-49ae-92f5-e8b2e056339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa484838-d857-49ae-92f5-e8b2e056339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a16f0c-edfd-4e27-883d-0d8ce5882189', 'volume_name': 'volume-41a16f0c-edfd-4e27-883d-0d8ce5882189', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fadb281-6d9d-4672-85e0-1365764719a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fadb281-6d9d-4672-85e0-1365764719a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc11037-166d-4ee3-bf84-d07e99c489f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:47 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume 41a16f0c-edfd-4e27-883d-0d8ce5882189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a16f0c-edfd-4e27-883d-0d8ce5882189', 'volume_size': 1} Aug 05 15:53:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (ee6d2963-f657-4a1e-bde3-7c19c4aaacdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7f65d1-cfa3-47ab-b586-1bc85fc62fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7f65d1-cfa3-47ab-b586-1bc85fc62fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101200796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949e7644-d4c3-4433-91d9-1c3b1bdbaa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:48Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc594b4-6b1e-4c31-a86a-8a55353dc07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc594b4-6b1e-4c31-a86a-8a55353dc07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb617ed-d9d4-4124-a07b-4d8965f34514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb617ed-d9d4-4124-a07b-4d8965f34514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949e7644-d4c3-4433-91d9-1c3b1bdbaa4a', 'volume_name': 'volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567c19ab-49bd-48d5-8fa6-b2886f528bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567c19ab-49bd-48d5-8fa6-b2886f528bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dc1cb7-75b1-4202-a438-e675859426a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume 949e7644-d4c3-4433-91d9-1c3b1bdbaa4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a', 'volume_size': 1} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a 1073741824" returned: 0 in 0.847s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (327340c8-853f-48c4-bf86-35548ef8ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff03183d-2472-4a1b-8b40-b8e89ff5c9c3', 'volume_name': 'volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3', 'volume_size': 1, 'image_id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05516654f3466d14c84407a046e46eb3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d2fe6a1388c4adba61c483b6178a1a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba6aa94b3bef507549422dbf515ff4702dd17b189bf1b09cfb12433e2d3bd8800958f9b7b983a8f95063f034d7ce2b1fb286c132e0701ed6378539cbe25b0332', 'id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'created_at': datetime.datetime(2026, 8, 5, 13, 53, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 53, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e/file', 'properties': {}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af8e495-ccdd-4751-a661-fc9530f4dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af8e495-ccdd-4751-a661-fc9530f4dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855fbd2f-31b7-4a74-9229-e93ce15c551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Volume ff03183d-2472-4a1b-8b40-b8e89ff5c9c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3', 'volume_size': 1, 'image_id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05516654f3466d14c84407a046e46eb3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d2fe6a1388c4adba61c483b6178a1a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba6aa94b3bef507549422dbf515ff4702dd17b189bf1b09cfb12433e2d3bd8800958f9b7b983a8f95063f034d7ce2b1fb286c132e0701ed6378539cbe25b0332', 'id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'created_at': datetime.datetime(2026, 8, 5, 13, 53, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 53, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e/file', 'properties': {}}, 'image_service': } Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Trying to clone ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 from image 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e at location (None, [{'url': 'file:///opt/stack/data/glance/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:48 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a Aug 05 15:53:48 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:53:48 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Image download 0.00 MB at 0.00 MB/s Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[69da3aa5-35f8-46d9-983e-faefab9def6a]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:48 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD Aug 05 15:53:48 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:48 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a" returned: 0 in 0.348s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.873s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1971492335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc7c8def-c27a-40ac-8932-f5e00ec1c157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:47Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Creating volume cc7c8def-c27a-40ac-8932-f5e00ec1c157 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:48 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (246fe239-1748-411b-bc69-95ac65ae23f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80f843e-b502-40cc-84b9-6ea5409c295a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea461f04-cacf-48c4-800d-d14434227bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume volume-b80f843e-b502-40cc-84b9-6ea5409c295a (b80f843e-b502-40cc-84b9-6ea5409c295a): created successfully Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea461f04-cacf-48c4-800d-d14434227bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 1073741824 Aug 05 15:53:48 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (977872e4-028a-42d4-b070-b1eea702f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5c083555-de9c-47fd-bf31-d7eb4a4e54b4 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created volume successfully. Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Flow 'volume_create_manager' (546f5e82-832c-4922-917e-bcfe40beebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9b4e30-31ce-4c08-93ed-09d39ea66676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9b4e30-31ce-4c08-93ed-09d39ea66676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c05197-91c6-45ae-bcc3-63bd14a6deef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d1b23ec2ed403e95ee6a343a5a9c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:49Z,use_quota=True,user_id='6a31d67bdd914ee58ddcb50dcba7df91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8571c7f5-c92f-449f-ab6a-1e25aff51041),volume_type_id=8571c7f5-c92f-449f-ab6a-1e25aff51041)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b6ed37-35db-4867-8b26-62216977fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b6ed37-35db-4867-8b26-62216977fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab9be49-784e-43b8-b49f-de8732c9206d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG cinder.image.glance [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Creating Keystone auth plugin from conf {{(pid=88999) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 05 15:53:48 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:48 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD Aug 05 15:53:48 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:49 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 1073741824" returned: 0 in 0.627s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:49 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD" returned: 1 in 0.438s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Temporary image 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e is fetched for user cd7ed389b57c4d84bdd1db604d8edbde. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:53:49 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 Aug 05 15:53:49 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab9be49-784e-43b8-b49f-de8732c9206d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a0c05197-91c6-45ae-bcc3-63bd14a6deef', 'volume_name': 'volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef', 'volume_size': 1, 'image_id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '156d3e985ef9376a5444394714ca7055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b3d1b23ec2ed403e95ee6a343a5a9c7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b7b820dbbb12b4407fb8f10c30ffadc8c66801ecebc42bf8de01117f73268e062d515d0e6ee12452aefe2094aff7588d1d1a557917bdae8d9e14802868997d0', 'id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'created_at': datetime.datetime(2026, 8, 5, 13, 53, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 53, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c38021b-4fd0-4fc0-a4d2-6383680d77df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c38021b-4fd0-4fc0-a4d2-6383680d77df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2aebd0-f043-471e-8f1d-4d4bea54e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:49 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Volume a0c05197-91c6-45ae-bcc3-63bd14a6deef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef', 'volume_size': 1, 'image_id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '156d3e985ef9376a5444394714ca7055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b3d1b23ec2ed403e95ee6a343a5a9c7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b7b820dbbb12b4407fb8f10c30ffadc8c66801ecebc42bf8de01117f73268e062d515d0e6ee12452aefe2094aff7588d1d1a557917bdae8d9e14802868997d0', 'id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'created_at': datetime.datetime(2026, 8, 5, 13, 53, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 53, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Trying to clone a0c05197-91c6-45ae-bcc3-63bd14a6deef from image 1cbca150-22e7-44eb-9dfb-910b8838cfa3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'metadata': {}}]). {{(pid=88999) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18e049-c38f-4416-a62b-8d295e711919]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 05 15:53:49 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Image download 0.00 MB at 0.00 MB/s Aug 05 15:53:49 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157" returned: 0 in 0.277s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:49 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD Aug 05 15:53:49 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918396358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a16f0c-edfd-4e27-883d-0d8ce5882189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:47Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Creating volume 41a16f0c-edfd-4e27-883d-0d8ce5882189 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:49 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd598881-6cbf-487c-b8a8-47b170abd630]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02579b5c-5a3a-4093-b14d-c8b3cbedc1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6d119e-fefc-419c-a223-e41a63933dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:49 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 1073741824 Aug 05 15:53:49 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:49 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 (cc7c8def-c27a-40ac-8932-f5e00ec1c157): created successfully Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc6d119e-fefc-419c-a223-e41a63933dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (57e6b8b2-02a4-4da0-a288-7267163137f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-96433969-dcd4-4d64-ac91-16606eb43979 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created volume successfully. Aug 05 15:53:49 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD Aug 05 15:53:49 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:49 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:49 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD Aug 05 15:53:49 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:50 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:50 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 1073741824" returned: 0 in 0.560s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:50 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD Aug 05 15:53:50 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:50 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD" returned: 1 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:50 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 Aug 05 15:53:50 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:50 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD" returned: 1 in 0.495s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Temporary image 1cbca150-22e7-44eb-9dfb-910b8838cfa3 is fetched for user 6a31d67bdd914ee58ddcb50dcba7df91. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 05 15:53:50 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189" returned: 0 in 0.343s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2101200796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=949e7644-d4c3-4433-91d9-1c3b1bdbaa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='defa7308a7094902ab0f1b9c3d179db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:48Z,use_quota=True,user_id='208cb228ac624a3196f975de82f030d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Creating volume 949e7644-d4c3-4433-91d9-1c3b1bdbaa4a {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:50 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:50 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a 1073741824 Aug 05 15:53:50 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (6e9f7e58-7ec2-4e1f-8863-bc36b95fba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db1a727-cac5-4171-9b5e-9c55f8a66e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cc11037-166d-4ee3-bf84-d07e99c489f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a16f0c-edfd-4e27-883d-0d8ce5882189', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7afca8-7c5a-42e2-978f-7d0fe3ab0bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db1a727-cac5-4171-9b5e-9c55f8a66e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362503108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2411d48-95ca-4381-b5b4-73257f15232b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:50Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138db82b-2d5b-4372-9b1c-cfe14395b5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138db82b-2d5b-4372-9b1c-cfe14395b5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e78706e-9530-4994-b654-effe6cde7462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e78706e-9530-4994-b654-effe6cde7462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2411d48-95ca-4381-b5b4-73257f15232b', 'volume_name': 'volume-f2411d48-95ca-4381-b5b4-73257f15232b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5270ffcc-071b-4bf7-8e76-c9500f9bd63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5270ffcc-071b-4bf7-8e76-c9500f9bd63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c195df-b964-4551-8762-31e49fdf3364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Volume f2411d48-95ca-4381-b5b4-73257f15232b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2411d48-95ca-4381-b5b4-73257f15232b', 'volume_size': 1} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 (41a16f0c-edfd-4e27-883d-0d8ce5882189): created successfully Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7afca8-7c5a-42e2-978f-7d0fe3ab0bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (357c6fce-83a6-45b0-974a-e455b79c5853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:50 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-126e7208-004a-4b25-b4e9-d61f4c12423c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created volume successfully. Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b2455f-b6e5-455f-a97e-c959b7908a39]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:50 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD Aug 05 15:53:50 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:51 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a 1073741824" returned: 0 in 0.461s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:51 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:51 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a Aug 05 15:53:51 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:51 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD Aug 05 15:53:51 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:51 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff03183d-2472-4a1b-8b40-b8e89ff5c9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d2fe6a1388c4adba61c483b6178a1a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:47Z,use_quota=True,user_id='cd7ed389b57c4d84bdd1db604d8edbde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Creating volume ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:51 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7dc1cb7-75b1-4202-a438-e675859426a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103f9fa5-bd78-4984-87e9-19764e6421b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:51 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 1073741824 Aug 05 15:53:51 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:51 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Volume volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a (949e7644-d4c3-4433-91d9-1c3b1bdbaa4a): created successfully Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (103f9fa5-bd78-4984-87e9-19764e6421b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Flow 'volume_create_manager' (ee6d2963-f657-4a1e-bde3-7c19c4aaacdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c356791b-c938-4c81-9bbb-8e4df21e2d28 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created volume successfully. Aug 05 15:53:51 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-quobyte-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22bf604-821a-49a8-9c0c-3b48d2eeba8b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:51 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a Aug 05 15:53:51 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:51 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 1073741824" returned: 0 in 0.489s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:51 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 Aug 05 15:53:51 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a" returned: 0 in 0.366s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a Aug 05 15:53:52 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.416s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-362503108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2411d48-95ca-4381-b5b4-73257f15232b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:50Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Creating volume f2411d48-95ca-4381-b5b4-73257f15232b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:52 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b 1073741824 Aug 05 15:53:52 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Attempting download of 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e ((None, [{'url': 'file:///opt/stack/data/glance/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'metadata': {}}])) to volume ff03183d-2472-4a1b-8b40-b8e89ff5c9c3. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c193e343-2aea-4436-bfdf-5b5e9e4fdead]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a" released by "delete_volume" :: held 0.660s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:52 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv Aug 05 15:53:52 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created reservations ['72527d58-ae93-40b6-954f-5f2dcc4f48db', '735f2d2e-9f93-4621-9588-ca71a0150781', '10fd7fce-f361-4503-af87-0914f790061f', '03e0a286-48c9-4d8a-9bf4-59e9b1a109da'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:52 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv" returned: 0 in 0.386s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b 1073741824" returned: 0 in 0.482s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b Aug 05 15:53:52 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv Aug 05 15:53:52 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.295s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-41a16f0c-edfd-4e27-883d-0d8ce5882189-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Deleted volume successfully. Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-41a16f0c-edfd-4e27-883d-0d8ce5882189-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5d725242-aace-4c78-8f64-510c8b2780dd tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-949e7644-d4c3-4433-91d9-1c3b1bdbaa4a-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-quobyte-41a16f0c-edfd-4e27-883d-0d8ce5882189" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-41a16f0c-edfd-4e27-883d-0d8ce5882189" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0bca11-5fee-4fea-93bc-031225faf3ff]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 Aug 05 15:53:52 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:52 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv" returned: 1 in 0.383s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_l1sqsnbv' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2176f0e-0495-45eb-9d9a-8e4c2aad110a]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:52 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b" returned: 0 in 0.344s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.564s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0c05197-91c6-45ae-bcc3-63bd14a6deef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d1b23ec2ed403e95ee6a343a5a9c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:49Z,use_quota=True,user_id='6a31d67bdd914ee58ddcb50dcba7df91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8571c7f5-c92f-449f-ab6a-1e25aff51041),volume_type_id=8571c7f5-c92f-449f-ab6a-1e25aff51041)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Creating volume a0c05197-91c6-45ae-bcc3-63bd14a6deef {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:53 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c195df-b964-4551-8762-31e49fdf3364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2411d48-95ca-4381-b5b4-73257f15232b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827a617c-b4ae-4511-ae46-ad828f166696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:53 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef 1073741824 Aug 05 15:53:53 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Volume volume-f2411d48-95ca-4381-b5b4-73257f15232b (f2411d48-95ca-4381-b5b4-73257f15232b): created successfully Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827a617c-b4ae-4511-ae46-ad828f166696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (6e9f7e58-7ec2-4e1f-8863-bc36b95fba86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6a5b4c8d-ce6e-4f71-8f8e-7cfdb5de4d77 tempest-ProjectReaderTests-1700152490 None] Created volume successfully. Aug 05 15:53:53 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD Aug 05 15:53:53 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189" returned: 0 in 0.373s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:53 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189 Aug 05 15:53:53 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:53 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD Aug 05 15:53:53 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-41a16f0c-edfd-4e27-883d-0d8ce5882189" returned: 0 in 0.260s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-41a16f0c-edfd-4e27-883d-0d8ce5882189" released by "delete_volume" :: held 0.680s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef 1073741824" returned: 0 in 0.493s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:53 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef Aug 05 15:53:53 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created reservations ['53930b0d-da18-468d-a4f9-39ee32a34e09', 'd796814f-2e28-4269-815c-d8a3a370b911', '213ffd1f-32f0-4eda-beea-7d1b936a5bcc', '407a6759-2eb1-4127-9e0b-5caaf4fc5884'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:53 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e was raw, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:53 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:53 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 Aug 05 15:53:53 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:53 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef" returned: 0 in 0.370s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-cc7c8def-c27a-40ac-8932-f5e00ec1c157-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:53 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-f2411d48-95ca-4381-b5b4-73257f15232b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.295s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Deleted volume successfully. Aug 05 15:53:53 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Attempting download of 1cbca150-22e7-44eb-9dfb-910b8838cfa3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'metadata': {}}])) to volume a0c05197-91c6-45ae-bcc3-63bd14a6deef. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-cc7c8def-c27a-40ac-8932-f5e00ec1c157-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-f2411d48-95ca-4381-b5b4-73257f15232b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b7e823fc-c41a-40c6-803f-2e019320e581 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-41a16f0c-edfd-4e27-883d-0d8ce5882189-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-quobyte-cc7c8def-c27a-40ac-8932-f5e00ec1c157" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-quobyte-f2411d48-95ca-4381-b5b4-73257f15232b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-f2411d48-95ca-4381-b5b4-73257f15232b" acquired by "delete_volume" :: waited 0.039s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-cc7c8def-c27a-40ac-8932-f5e00ec1c157" acquired by "delete_volume" :: waited 0.072s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d86ce95-4f97-42a6-8ea8-9bad32028fcb]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[269684f1-34dd-4b95-8892-f4e093c978eb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a018f82-f037-4906-afab-e93689c11fe1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b Aug 05 15:53:54 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu Aug 05 15:53:54 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" returned: 0 in 0.639s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e_pdfidnn3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:53:54 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 Aug 05 15:53:54 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 1G Aug 05 15:53:54 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu" returned: 0 in 0.376s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b" returned: 0 in 0.437s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b Aug 05 15:53:54 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157" returned: 0 in 0.464s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157 Aug 05 15:53:54 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu Aug 05 15:53:54 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:54 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 1G" returned: 0 in 0.442s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Downloaded image 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e ((None, [{'url': 'file:///opt/stack/data/glance/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'metadata': {}}])) to volume ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Temporary image 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e for user cd7ed389b57c4d84bdd1db604d8edbde is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Marking volume ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Copying metadata from image 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e to ff03183d-2472-4a1b-8b40-b8e89ff5c9c3. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Creating volume glance metadata for volume ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 backed by image 3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e with: {'image_id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '05516654f3466d14c84407a046e46eb3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855fbd2f-31b7-4a74-9229-e93ce15c551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3', 'volume_size': 1, 'image_id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '05516654f3466d14c84407a046e46eb3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8d2fe6a1388c4adba61c483b6178a1a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba6aa94b3bef507549422dbf515ff4702dd17b189bf1b09cfb12433e2d3bd8800958f9b7b983a8f95063f034d7ce2b1fb286c132e0701ed6378539cbe25b0332', 'id': '3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e', 'created_at': datetime.datetime(2026, 8, 5, 13, 53, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 53, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3b6e41b8-a12b-4c36-91d2-ea522cd9fe6e/file', 'properties': {}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eba2ec7-8f7e-4572-a1e6-75feeb049418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:54 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Volume volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 (ff03183d-2472-4a1b-8b40-b8e89ff5c9c3): created successfully Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eba2ec7-8f7e-4572-a1e6-75feeb049418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Flow 'volume_create_manager' (89f11271-56e4-465c-afee-2fe2f4540c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fa8c4381-b68d-4820-9706-90481897bce1 tempest-VolumeImageDependencyTests-1576990950 None] Created volume successfully. Aug 05 15:53:54 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2411d48-95ca-4381-b5b4-73257f15232b" returned: 0 in 0.313s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu" returned: 1 in 0.396s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbca150-22e7-44eb-9dfb-910b8838cfa3_8jqdlezu' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b60ee6-709f-4ccf-a2e8-cbcd8ad08bd3]: (4, 'raw') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:54 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-f2411d48-95ca-4381-b5b4-73257f15232b" released by "delete_volume" :: held 0.834s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cc7c8def-c27a-40ac-8932-f5e00ec1c157" returned: 0 in 0.308s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-cc7c8def-c27a-40ac-8932-f5e00ec1c157" released by "delete_volume" :: held 0.830s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Created reservations ['1bcabbd2-829a-41c1-9388-112332555b18', '83545caa-ab37-4697-b159-3e15f49daeac', '344d333c-febf-4f65-a734-2f487e400bb5', '81575612-f4c0-425c-8be0-a4b9cb0c2d01'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created reservations ['b5be8f20-0ed4-49a1-a700-ca5d24639b56', '13ad5963-72d8-41d1-9d3d-0acbc41aa17f', '2c7e5061-d4f2-4825-85fd-a6bb78121134', 'a1362f1d-ce7a-4a5a-8ccc-146211679535'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:55 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD Aug 05 15:53:55 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:55 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:55 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Acquiring lock "cinder-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:55 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.292s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Lock "cinder-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Deleted volume successfully. Aug 05 15:53:55 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.373s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Deleted volume successfully. Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-3d30fd7a-b960-41c9-b316-546f6ce4b0d7 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-cc7c8def-c27a-40ac-8932-f5e00ec1c157-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:55 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD Aug 05 15:53:55 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-1b4a23a3-92b0-4296-b8c5-61f55b02a214 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-f2411d48-95ca-4381-b5b4-73257f15232b-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Acquiring lock "cinder-quobyte-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Lock "cinder-quobyte-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23892b6-7bfd-46f5-b69c-a49aa50ede88]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 Aug 05 15:53:55 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD" returned: 1 in 0.451s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD' failed. Not Retrying. {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] 1cbca150-22e7-44eb-9dfb-910b8838cfa3 was raw, converting to qcow2 {{(pid=88999) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:55 devstack sudo[107648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef Aug 05 15:53:55 devstack sudo[107648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (2cb2f0b7-bbed-476c-9a65-c95406f9c8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d900e74-5190-49d0-b5ad-068ce785f21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d900e74-5190-49d0-b5ad-068ce785f21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462491521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf19db08-21e8-4776-8dc3-a8ff2e04f5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:56Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dc1a69-dc79-4a65-8a0b-214bb4795491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71dc1a69-dc79-4a65-8a0b-214bb4795491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498aba60-6344-4d44-86f2-85d749fa4f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:56 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498aba60-6344-4d44-86f2-85d749fa4f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf19db08-21e8-4776-8dc3-a8ff2e04f5d3', 'volume_name': 'volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fdb638-3989-421d-ba44-aa0bde686183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9fdb638-3989-421d-ba44-aa0bde686183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411bd2bb-40c0-4900-8c3c-da58fabfa11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:56 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Volume cf19db08-21e8-4776-8dc3-a8ff2e04f5d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3', 'volume_size': 1} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462491521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf19db08-21e8-4776-8dc3-a8ff2e04f5d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:53:56Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Creating volume cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:53:56 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" returned: 0 in 0.421s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 1073741824 Aug 05 15:53:56 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3 Aug 05 15:53:56 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-b80f843e-b502-40cc-84b9-6ea5409c295a-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-b80f843e-b502-40cc-84b9-6ea5409c295a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:56 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" returned: 0 in 0.304s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Lock "cinder-quobyte-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3" released by "delete_volume" :: held 0.787s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-quobyte-b80f843e-b502-40cc-84b9-6ea5409c295a" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:56 devstack sudo[107648]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef" returned: 0 in 0.568s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cbca150-22e7-44eb-9dfb-910b8838cfa3_0zb3il59devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:53:56 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Converted 0.00 MB image at 0.00 MB/s Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-b80f843e-b502-40cc-84b9-6ea5409c295a" acquired by "delete_volume" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:56 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef 1G Aug 05 15:53:56 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b03054-39b2-4be4-952a-9180cdd8f7a9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Created reservations ['0bef2a97-f9e0-450d-80c6-b902ba7457c0', 'f9743d40-df2b-4cf5-a63f-8aaca9a0c4ee', '57bae044-d4aa-479f-bf3c-025f557eda3d', '8c971d15-53a5-4bed-b55b-ed171e6300d1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:56 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 1073741824" returned: 0 in 0.519s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:56 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:56 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:56 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:56 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 Aug 05 15:53:56 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:56 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef 1G" returned: 0 in 0.436s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Downloaded image 1cbca150-22e7-44eb-9dfb-910b8838cfa3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'metadata': {}}])) to volume a0c05197-91c6-45ae-bcc3-63bd14a6deef successfully. {{(pid=88999) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Temporary image 1cbca150-22e7-44eb-9dfb-910b8838cfa3 for user 6a31d67bdd914ee58ddcb50dcba7df91 is deleted. {{(pid=88999) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.volume_utils [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Marking volume a0c05197-91c6-45ae-bcc3-63bd14a6deef as bootable. {{(pid=88999) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Copying metadata from image 1cbca150-22e7-44eb-9dfb-910b8838cfa3 to a0c05197-91c6-45ae-bcc3-63bd14a6deef. {{(pid=88999) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Creating volume glance metadata for volume a0c05197-91c6-45ae-bcc3-63bd14a6deef backed by image 1cbca150-22e7-44eb-9dfb-910b8838cfa3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '156d3e985ef9376a5444394714ca7055', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88999) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 05 15:53:56 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3" returned: 0 in 0.320s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:53:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2aebd0-f043-471e-8f1d-4d4bea54e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef', 'volume_size': 1, 'image_id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '156d3e985ef9376a5444394714ca7055', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b3d1b23ec2ed403e95ee6a343a5a9c7a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9b7b820dbbb12b4407fb8f10c30ffadc8c66801ecebc42bf8de01117f73268e062d515d0e6ee12452aefe2094aff7588d1d1a557917bdae8d9e14802868997d0', 'id': '1cbca150-22e7-44eb-9dfb-910b8838cfa3', 'created_at': datetime.datetime(2026, 8, 5, 13, 53, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 5, 13, 53, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cbca150-22e7-44eb-9dfb-910b8838cfa3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:57 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d18ab2-b59f-40d1-9bf3-e718afc31a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (411bd2bb-40c0-4900-8c3c-da58fabfa11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f532b7-d382-4c51-a3c7-ad2a7b48c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:53:57 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a" returned: 0 in 0.564s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:57 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Volume volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef (a0c05197-91c6-45ae-bcc3-63bd14a6deef): created successfully Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d18ab2-b59f-40d1-9bf3-e718afc31a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:57 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Flow 'volume_create_manager' (546f5e82-832c-4922-917e-bcfe40beebe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:57 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.455s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:57 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Volume volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 (cf19db08-21e8-4776-8dc3-a8ff2e04f5d3): created successfully Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f532b7-d382-4c51-a3c7-ad2a7b48c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (2cb2f0b7-bbed-476c-9a65-c95406f9c8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:53:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Deleted volume successfully. Aug 05 15:53:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9ac269ae-a82f-47c5-b808-a58ecaa9765e tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Created volume successfully. Aug 05 15:53:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f93c35ad-9847-4cad-906b-a5dc0f11c694 tempest-ProjectReaderTests-1700152490 None] Created volume successfully. Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c52c045e-c3f5-4c69-8167-c74624c1dc8e tempest-VolumeImageDependencyTests-1576990950 None] Lock "cinder-ff03183d-2472-4a1b-8b40-b8e89ff5c9c3-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:57 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b80f843e-b502-40cc-84b9-6ea5409c295a" returned: 0 in 0.278s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Acquiring lock "cinder-a0c05197-91c6-45ae-bcc3-63bd14a6deef-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-b80f843e-b502-40cc-84b9-6ea5409c295a" released by "delete_volume" :: held 0.900s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "cinder-a0c05197-91c6-45ae-bcc3-63bd14a6deef-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Acquiring lock "cinder-quobyte-a0c05197-91c6-45ae-bcc3-63bd14a6deef" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "cinder-quobyte-a0c05197-91c6-45ae-bcc3-63bd14a6deef" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created reservations ['543eff6a-6ef2-47fe-b7af-951d3ce2076f', '65e8f827-c730-4178-94e9-8b38d5313c6a', '2e25ccc0-6a25-4526-b7ce-823849c7d6b4', '8957139e-b737-460b-830f-d8dc29914421'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b992a2-2cc5-4188-bffd-208eafed77b5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:57 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:57 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:57 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef Aug 05 15:53:57 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:57 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Deleted volume successfully. Aug 05 15:53:57 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef" returned: 0 in 0.397s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-dab28c85-c0bf-4ea0-8754-ce7335c52cc0 tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-b80f843e-b502-40cc-84b9-6ea5409c295a-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:57 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef Aug 05 15:53:57 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:58 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a0c05197-91c6-45ae-bcc3-63bd14a6deef" returned: 0 in 0.273s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "cinder-quobyte-a0c05197-91c6-45ae-bcc3-63bd14a6deef" released by "delete_volume" :: held 0.730s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-quobyte-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a92716-f5bb-448f-bf6b-2d7d735ab300]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Created reservations ['7f9bec40-e475-447d-8f0d-03028f482ee1', '873ed035-e62f-42e5-b79e-ba7f29d361f9', '66c5546b-9e38-4863-b01b-400d9c575336', '5cffd658-1e51-4aa5-85dd-17057546fd62'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:58 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 Aug 05 15:53:58 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:58 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:58 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-1332cc26-1f33-4820-83ff-7ce169499c24-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-1332cc26-1f33-4820-83ff-7ce169499c24-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-quobyte-1332cc26-1f33-4820-83ff-7ce169499c24" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-1332cc26-1f33-4820-83ff-7ce169499c24" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca7c76c-fa32-47dc-8d05-26696fbc52b1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:58 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Deleted volume successfully. Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-df3b28c1-d831-4639-9af2-9f4e36df1aa1 tempest-VolumeAndVolumeTypeFromImageTest-1104087376 None] Lock "cinder-a0c05197-91c6-45ae-bcc3-63bd14a6deef-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:58 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3" returned: 0 in 0.609s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:58 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3 Aug 05 15:53:58 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:58 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 Aug 05 15:53:58 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:59 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3" returned: 0 in 0.323s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3" released by "delete_volume" :: held 0.984s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:59 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24" returned: 0 in 0.457s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:59 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24 Aug 05 15:53:59 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Created reservations ['ff4d31e9-1cd9-4763-95e1-fb1eed05394e', 'c37bf178-1cbc-498b-8fb1-13f519ca216c', '47212124-ff23-4f03-9742-210734f17690', '23be5805-907b-417e-b1bc-5bed872a7753'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:59 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:59 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:59 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1332cc26-1f33-4820-83ff-7ce169499c24" returned: 0 in 0.321s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-1332cc26-1f33-4820-83ff-7ce169499c24" released by "delete_volume" :: held 0.833s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created reservations ['64a5fb82-e6ff-4f89-a110-45430ce9a896', 'a52dcb3f-013d-4bab-a376-f88d64f08ffc', '00e7341e-359e-40af-956b-0af74c446a5b', 'd31c94ec-7d64-4645-86b4-d6f792b5fb6b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:53:59 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:53:59 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:53:59 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:53:59 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Deleted volume successfully. Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-2f752355-1f73-41a9-b3b5-a3df11e52536-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-2f752355-1f73-41a9-b3b5-a3df11e52536-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7e2f831a-b9c8-486f-b915-ae8166d46194 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-cf19db08-21e8-4776-8dc3-a8ff2e04f5d3-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:53:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "cinder-quobyte-2f752355-1f73-41a9-b3b5-a3df11e52536" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-2f752355-1f73-41a9-b3b5-a3df11e52536" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc08a09-c21b-4f6c-9b6c-916dcc34d737]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:00 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.393s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:00 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Deleted volume successfully. Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a235c4b7-3984-45d6-8fc8-078b715f831c tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-1332cc26-1f33-4820-83ff-7ce169499c24-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:00 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 Aug 05 15:54:00 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:00 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536" returned: 0 in 0.476s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:00 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536 Aug 05 15:54:00 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:00 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-2f752355-1f73-41a9-b3b5-a3df11e52536" returned: 0 in 0.374s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-quobyte-2f752355-1f73-41a9-b3b5-a3df11e52536" released by "delete_volume" :: held 0.909s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:00 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Created reservations ['b395d403-1778-4027-9d5d-960935556adf', '127edd3a-fbea-4fde-a744-97283d88a563', '5b0300d8-d3ca-40c1-98e3-24a486f4e238', '28549e08-395b-4d9b-8988-be00e96e65f2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:01 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:01 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (5ccf89ea-fbf2-4d53-9cac-0b513afbb401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab819108-c099-4510-ad2a-0ffd374a2f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab819108-c099-4510-ad2a-0ffd374a2f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350335056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc5e131-b943-4b7c-8a9d-2c5739bd87a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:01Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c81638-012c-4cbd-8648-f5aada3775bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8c81638-012c-4cbd-8648-f5aada3775bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eb2b95-60df-4d42-8c76-5fe5721e3fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1eb2b95-60df-4d42-8c76-5fe5721e3fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc5e131-b943-4b7c-8a9d-2c5739bd87a5', 'volume_name': 'volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f2bf8-2d7a-4d5e-a04e-c1c863fbc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894f2bf8-2d7a-4d5e-a04e-c1c863fbc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daf9a9b-eea0-4c0e-9837-cd27579697ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Volume edc5e131-b943-4b7c-8a9d-2c5739bd87a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5', 'volume_size': 1} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350335056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc5e131-b943-4b7c-8a9d-2c5739bd87a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:01Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Creating volume edc5e131-b943-4b7c-8a9d-2c5739bd87a5 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:01 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:01 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 1073741824 Aug 05 15:54:01 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Flow 'volume_create_manager' (60e15653-1f67-4da6-9b53-d5be100d47f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5df4bed-b516-4027-a424-3ed36940a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5df4bed-b516-4027-a424-3ed36940a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7165a5b5-d720-4342-8ee7-0ce880e25cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daadca4b8dd4006ad7cf6d26c484d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:01Z,use_quota=True,user_id='08c6a5eff90747ac93e2915ff1710e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e720312-b639-4007-b690-2e96407df0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e720312-b639-4007-b690-2e96407df0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6c4004-2c5c-490b-a8ef-61f1eacaeb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6c4004-2c5c-490b-a8ef-61f1eacaeb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7165a5b5-d720-4342-8ee7-0ce880e25cbe', 'volume_name': 'volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee73d31b-48b4-4e56-a207-df6029a3861a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee73d31b-48b4-4e56-a207-df6029a3861a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac5f30c-0435-4447-b25a-0c08b7ff0aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:01 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Volume 7165a5b5-d720-4342-8ee7-0ce880e25cbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe', 'volume_size': 1} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.439s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Deleted volume successfully. Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c4a4b377-9abb-4b78-ac52-cada82f6c27e tempest-CreateVolumesFromSourceVolumeTest-1280744002 None] Lock "cinder-2f752355-1f73-41a9-b3b5-a3df11e52536-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:01 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 1073741824" returned: 0 in 0.554s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:02 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 Aug 05 15:54:02 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:02 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5" returned: 0 in 0.319s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7165a5b5-d720-4342-8ee7-0ce880e25cbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daadca4b8dd4006ad7cf6d26c484d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:01Z,use_quota=True,user_id='08c6a5eff90747ac93e2915ff1710e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Creating volume 7165a5b5-d720-4342-8ee7-0ce880e25cbe {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:02 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daf9a9b-eea0-4c0e-9837-cd27579697ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c453e6d5-f89c-4fbd-b8c6-63ceba088887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:02 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe 1073741824 Aug 05 15:54:02 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:02 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Volume volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 (edc5e131-b943-4b7c-8a9d-2c5739bd87a5): created successfully Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c453e6d5-f89c-4fbd-b8c6-63ceba088887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (5ccf89ea-fbf2-4d53-9cac-0b513afbb401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:02 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f33c58df-14cc-4797-a010-e33e353ca345 tempest-ProjectReaderTests-1700152490 None] Created volume successfully. Aug 05 15:54:02 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe 1073741824" returned: 0 in 0.507s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:02 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe Aug 05 15:54:02 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:03 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac5f30c-0435-4447-b25a-0c08b7ff0aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa921a24-59d4-446e-847a-ac3f100ef195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:03 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Volume volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe (7165a5b5-d720-4342-8ee7-0ce880e25cbe): created successfully Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa921a24-59d4-446e-847a-ac3f100ef195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Flow 'volume_create_manager' (60e15653-1f67-4da6-9b53-d5be100d47f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4056b9db-e03f-40c5-a12f-33ba0d28f28e tempest-CinderUnicodeTest-563852939 None] Created volume successfully. Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-edc5e131-b943-4b7c-8a9d-2c5739bd87a5-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-edc5e131-b943-4b7c-8a9d-2c5739bd87a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-quobyte-edc5e131-b943-4b7c-8a9d-2c5739bd87a5" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-edc5e131-b943-4b7c-8a9d-2c5739bd87a5" acquired by "delete_volume" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be965a-279c-406b-a9e5-7a79cacb65c9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:03 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 Aug 05 15:54:03 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:03 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5" returned: 0 in 0.438s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:03 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5 Aug 05 15:54:03 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:04 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-edc5e131-b943-4b7c-8a9d-2c5739bd87a5" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-edc5e131-b943-4b7c-8a9d-2c5739bd87a5" released by "delete_volume" :: held 0.745s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Created reservations ['009aced3-9f87-4c49-93eb-871badfea42f', '14d7c92c-a336-4822-bd9b-3a7bc550a432', '7d73812d-2bca-4dea-a32f-89def3454559', '2789e674-e42f-4a59-a3b8-a44e0536875d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:04 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:04 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:04 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.427s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Deleted volume successfully. Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0a4b78ef-0bd9-44fd-b23e-51b69a3be6c2 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-edc5e131-b943-4b7c-8a9d-2c5739bd87a5-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (9a2ac5cb-2041-492a-b10d-6dfc7e30a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeffbdd5-574c-428e-a08d-45689af584f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeffbdd5-574c-428e-a08d-45689af584f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554966197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc08003-75d3-479a-993b-7469a28fe570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:05Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bfbca2-bb1d-4130-b146-1f1f941a58de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4bfbca2-bb1d-4130-b146-1f1f941a58de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b79ef-2ff5-4e97-8c7e-777590d5bbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43b79ef-2ff5-4e97-8c7e-777590d5bbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc08003-75d3-479a-993b-7469a28fe570', 'volume_name': 'volume-ecc08003-75d3-479a-993b-7469a28fe570', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530743a8-59de-4812-8ab6-db16828fd97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (530743a8-59de-4812-8ab6-db16828fd97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7884fe17-f542-40a2-8d8a-9eb12e219c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:04 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Volume ecc08003-75d3-479a-993b-7469a28fe570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc08003-75d3-479a-993b-7469a28fe570', 'volume_size': 1} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554966197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecc08003-75d3-479a-993b-7469a28fe570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:05Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Creating volume ecc08003-75d3-479a-993b-7469a28fe570 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:04 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:05 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 1073741824 Aug 05 15:54:05 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Flow 'volume_create_manager' (8a5b0a7b-80c8-401a-ad7d-e98c9f6109f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb515e9-df29-462d-a388-b49a44e1ce0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb515e9-df29-462d-a388-b49a44e1ce0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1169898358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4f449a-b8e1-4431-a056-62e0ca19705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d3dc2bfba54cf6b740682d8a2d573b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:05Z,use_quota=True,user_id='1dfcfca76256427ab879a68f6025edd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadc3419-5ec8-400f-9f31-3768e219caca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadc3419-5ec8-400f-9f31-3768e219caca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b5aaf2-8812-4e6f-b140-842f089df7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b5aaf2-8812-4e6f-b140-842f089df7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b4f449a-b8e1-4431-a056-62e0ca19705e', 'volume_name': 'volume-8b4f449a-b8e1-4431-a056-62e0ca19705e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d37d2f-8268-4755-a2d6-02da5298fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d37d2f-8268-4755-a2d6-02da5298fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0280026-fc84-4aae-b4b6-645098616474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Volume 8b4f449a-b8e1-4431-a056-62e0ca19705e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b4f449a-b8e1-4431-a056-62e0ca19705e', 'volume_size': 1} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:05 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 1073741824" returned: 0 in 0.636s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (8d877392-9ba0-4808-ada2-5036428c54c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736fcac2-cb67-4a3c-b9b8-6af45ead1fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736fcac2-cb67-4a3c-b9b8-6af45ead1fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275839836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3007cdbb-d323-4ee3-987f-0b4f8f90fdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:05Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297994af-1d32-43f2-bef6-0e5bfc3539ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297994af-1d32-43f2-bef6-0e5bfc3539ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ad668f-bcbe-4afe-8a4f-c1af3349696c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ad668f-bcbe-4afe-8a4f-c1af3349696c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3007cdbb-d323-4ee3-987f-0b4f8f90fdc6', 'volume_name': 'volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc8245-4e12-4982-9062-aab3cf6ab13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6bc8245-4e12-4982-9062-aab3cf6ab13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4991c97-6e81-4fee-9970-72e19c3b7ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:05 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Volume 3007cdbb-d323-4ee3-987f-0b4f8f90fdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6', 'volume_size': 1} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:05 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 Aug 05 15:54:05 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:05 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570" returned: 0 in 0.247s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.798s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1169898358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4f449a-b8e1-4431-a056-62e0ca19705e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d3dc2bfba54cf6b740682d8a2d573b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:05Z,use_quota=True,user_id='1dfcfca76256427ab879a68f6025edd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Creating volume 8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:06 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7884fe17-f542-40a2-8d8a-9eb12e219c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc08003-75d3-479a-993b-7469a28fe570', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617f43aa-1aaf-4d08-9a19-5624f24be700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e 1073741824 Aug 05 15:54:06 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Volume volume-ecc08003-75d3-479a-993b-7469a28fe570 (ecc08003-75d3-479a-993b-7469a28fe570): created successfully Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617f43aa-1aaf-4d08-9a19-5624f24be700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (9a2ac5cb-2041-492a-b10d-6dfc7e30a116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:06 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8e0917dc-7ce3-43d9-b68a-34f7f028c077 tempest-CreateVolumesFromImageTest-300201769 None] Created volume successfully. Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (eb0aa33f-32c6-44b2-88ad-0cf48be8a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffc1770-e812-4837-aa85-63d6f0126b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ffc1770-e812-4837-aa85-63d6f0126b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-444206807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e8b32e-ab2d-47f4-8a7a-572c4df1ae54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:06Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f109116-5518-4d79-93a0-53db0422e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f109116-5518-4d79-93a0-53db0422e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df10d9c3-17a4-486e-8fc8-41692f1e4b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df10d9c3-17a4-486e-8fc8-41692f1e4b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e8b32e-ab2d-47f4-8a7a-572c4df1ae54', 'volume_name': 'volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8975cb35-567c-4ae1-8040-0b0772474d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8975cb35-567c-4ae1-8040-0b0772474d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70336d1d-cece-45c7-b535-c5473ffa6549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Volume 44e8b32e-ab2d-47f4-8a7a-572c4df1ae54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54', 'volume_size': 1} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:06 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e 1073741824" returned: 0 in 0.519s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:06 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e Aug 05 15:54:06 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Flow 'volume_create_manager' (eaacc7f4-a0ef-42c6-9e30-adf8c16a66b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcbe9b8-f9fb-4b35-af3d-4ec0eea3b414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e" returned: 0 in 0.338s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275839836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3007cdbb-d323-4ee3-987f-0b4f8f90fdc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:05Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Creating volume 3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:06 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fcbe9b8-f9fb-4b35-af3d-4ec0eea3b414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1237423982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bc6774-ca50-4863-a2b1-f08c715a2834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daadca4b8dd4006ad7cf6d26c484d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='08c6a5eff90747ac93e2915ff1710e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb392f54-8b8c-4f44-bdaa-2750e379b121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb392f54-8b8c-4f44-bdaa-2750e379b121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:06 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 1073741824 Aug 05 15:54:06 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403f2add-2524-41fe-85b1-3ea591b21af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403f2add-2524-41fe-85b1-3ea591b21af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bc6774-ca50-4863-a2b1-f08c715a2834', 'volume_name': 'volume-97bc6774-ca50-4863-a2b1-f08c715a2834', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b0d782-4e39-4b2c-8514-351016ba2b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63b0d782-4e39-4b2c-8514-351016ba2b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7db4aa3-da42-4c4a-a5e2-95b2109d81cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Volume 97bc6774-ca50-4863-a2b1-f08c715a2834: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bc6774-ca50-4863-a2b1-f08c715a2834', 'volume_size': 1} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (eb5a7e81-57d4-4086-8bd5-7442acdb9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9acf52-b85b-4921-81cd-cb8c504e258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (32d2263d-de17-4280-9fcc-837481dd7680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237b9aab-acb4-4f4b-8551-8cd4e789a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0280026-fc84-4aae-b4b6-645098616474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4f449a-b8e1-4431-a056-62e0ca19705e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92ed26e-d6e8-4ce4-b9e7-97a0e7aecd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (7aa6e6bd-93c7-4f38-b972-265b7c964e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a87073-49c8-44f4-8e9b-516353d9e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f9acf52-b85b-4921-81cd-cb8c504e258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193037605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3eb0a9-d5b4-443d-bed2-013199431451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb2eb7e-f3f9-4890-87fa-b762c2cc8076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb2eb7e-f3f9-4890-87fa-b762c2cc8076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0981953f-7098-40a0-80a7-84b025e80016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0981953f-7098-40a0-80a7-84b025e80016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c3eb0a9-d5b4-443d-bed2-013199431451', 'volume_name': 'volume-7c3eb0a9-d5b4-443d-bed2-013199431451', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288104f1-3936-42a2-a987-0b646ca1ae49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (288104f1-3936-42a2-a987-0b646ca1ae49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd35b033-5735-40f8-9975-62c17d238bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Volume 7c3eb0a9-d5b4-443d-bed2-013199431451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c3eb0a9-d5b4-443d-bed2-013199431451', 'volume_size': 1} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (237b9aab-acb4-4f4b-8551-8cd4e789a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2009110716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aab72f3-6073-4dd1-9c26-7aecba991afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85c2999-e0ff-4583-9f0c-93dce9116f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85c2999-e0ff-4583-9f0c-93dce9116f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc3ff1f-5267-4eb3-9843-7bc10a393b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc3ff1f-5267-4eb3-9843-7bc10a393b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aab72f3-6073-4dd1-9c26-7aecba991afd', 'volume_name': 'volume-7aab72f3-6073-4dd1-9c26-7aecba991afd', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac3b131-e0ff-4342-91ea-2b407e6d7ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac3b131-e0ff-4342-91ea-2b407e6d7ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38dad8-b823-471a-a607-52f7586e2ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Volume 7aab72f3-6073-4dd1-9c26-7aecba991afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aab72f3-6073-4dd1-9c26-7aecba991afd', 'volume_size': 1} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Volume volume-8b4f449a-b8e1-4431-a056-62e0ca19705e (8b4f449a-b8e1-4431-a056-62e0ca19705e): created successfully Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92ed26e-d6e8-4ce4-b9e7-97a0e7aecd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Flow 'volume_create_manager' (8a5b0a7b-80c8-401a-ad7d-e98c9f6109f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a87073-49c8-44f4-8e9b-516353d9e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419106460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10351a3c-c338-47e5-abca-a961d422a39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7650b60-6042-4617-8e44-8b34e74b577a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7650b60-6042-4617-8e44-8b34e74b577a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d890cfd-4e24-4df4-8eed-70d9f9541b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d890cfd-4e24-4df4-8eed-70d9f9541b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10351a3c-c338-47e5-abca-a961d422a39c', 'volume_name': 'volume-10351a3c-c338-47e5-abca-a961d422a39c', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adccde1-884b-41b0-90f2-62531cf9d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0adccde1-884b-41b0-90f2-62531cf9d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08abf6e4-f6ae-4676-96f7-7844c0d898ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Volume 10351a3c-c338-47e5-abca-a961d422a39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10351a3c-c338-47e5-abca-a961d422a39c', 'volume_size': 1} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e2070ab6-855a-4086-a032-3739d12045c2 tempest-VolumeDependencyTests-1374586020 None] Created volume successfully. Aug 05 15:54:07 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 1073741824" returned: 0 in 0.465s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:07 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 Aug 05 15:54:07 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:07 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6" returned: 0 in 0.259s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-444206807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e8b32e-ab2d-47f4-8a7a-572c4df1ae54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='605f4acc9637452caa7aabde95234ba4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:06Z,use_quota=True,user_id='ebffc7ac862c4677b9173b67f80de553',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Creating volume 44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:07 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 1073741824 Aug 05 15:54:07 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4991c97-6e81-4fee-9970-72e19c3b7ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95aea2fc-3ccc-4a9f-911b-dd586708e896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Volume volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 (3007cdbb-d323-4ee3-987f-0b4f8f90fdc6): created successfully Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95aea2fc-3ccc-4a9f-911b-dd586708e896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (8d877392-9ba0-4808-ada2-5036428c54c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5767caa3-5ff3-4f95-88d6-f18b91d5f8bc tempest-CreateVolumesFromImageTest-300201769 None] Created volume successfully. Aug 05 15:54:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:08 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 1073741824" returned: 0 in 0.431s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:08 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 Aug 05 15:54:08 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:08 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54" returned: 0 in 0.256s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1237423982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bc6774-ca50-4863-a2b1-f08c715a2834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3daadca4b8dd4006ad7cf6d26c484d37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='08c6a5eff90747ac93e2915ff1710e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Creating volume 97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:08 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70336d1d-cece-45c7-b535-c5473ffa6549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064992c3-82c1-4a58-8939-ff02f51c67e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:08 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 1073741824 Aug 05 15:54:08 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Volume volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 (44e8b32e-ab2d-47f4-8a7a-572c4df1ae54): created successfully Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (064992c3-82c1-4a58-8939-ff02f51c67e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Flow 'volume_create_manager' (eb0aa33f-32c6-44b2-88ad-0cf48be8a53f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:08 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a93d8cb4-3cf1-49c6-bf3d-ba13e046e488 tempest-ProjectReaderTests-1700152490 None] Created volume successfully. Aug 05 15:54:08 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 1073741824" returned: 0 in 0.432s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:08 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 Aug 05 15:54:08 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:09 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834" returned: 0 in 0.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193037605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c3eb0a9-d5b4-443d-bed2-013199431451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Creating volume 7c3eb0a9-d5b4-443d-bed2-013199431451 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:09 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7db4aa3-da42-4c4a-a5e2-95b2109d81cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bc6774-ca50-4863-a2b1-f08c715a2834', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:09 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 1073741824 Aug 05 15:54:09 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a2aad1-0e50-4029-9f5c-58813ca20923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:09 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Volume volume-97bc6774-ca50-4863-a2b1-f08c715a2834 (97bc6774-ca50-4863-a2b1-f08c715a2834): created successfully Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4a2aad1-0e50-4029-9f5c-58813ca20923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Flow 'volume_create_manager' (eaacc7f4-a0ef-42c6-9e30-adf8c16a66b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:09 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-48d0a738-6b37-4d9b-b7b4-6afd23f60fab tempest-CinderUnicodeTest-563852939 None] Created volume successfully. Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "cinder-quobyte-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4b1775-bef9-4866-87c2-b8191c1fce34]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:09 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 1073741824" returned: 0 in 0.505s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:09 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 Aug 05 15:54:09 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:09 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 Aug 05 15:54:09 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:10 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.787s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2009110716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aab72f3-6073-4dd1-9c26-7aecba991afd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Creating volume 7aab72f3-6073-4dd1-9c26-7aecba991afd {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd 1073741824 Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd35b033-5735-40f8-9975-62c17d238bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c3eb0a9-d5b4-443d-bed2-013199431451', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:10 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1b4a40-be50-4a9a-9608-4ccc4c5b72a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:10 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54" returned: 0 in 0.453s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54 Aug 05 15:54:10 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Volume volume-7c3eb0a9-d5b4-443d-bed2-013199431451 (7c3eb0a9-d5b4-443d-bed2-013199431451): created successfully Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f1b4a40-be50-4a9a-9608-4ccc4c5b72a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (eb5a7e81-57d4-4086-8bd5-7442acdb9f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d134a1ea-8e03-4d2e-b182-7c0fd2d97550 tempest-CreateVolumesFromImageTest-300201769 None] Created volume successfully. Aug 05 15:54:10 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:10 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54" returned: 0 in 0.272s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-quobyte-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54" released by "delete_volume" :: held 0.773s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:10 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Created reservations ['3dc810e8-84ef-4528-a63f-b4120140ae3c', 'f0e2385e-4eb3-4bc9-ac92-4f4746094734', '734cebbe-0943-4fd9-a425-571803c8656e', '60c595e6-ef01-48fb-b5da-99fefe1293bf'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:10 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd 1073741824" returned: 0 in 0.467s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:10 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd Aug 05 15:54:10 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.297s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.535s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-419106460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10351a3c-c338-47e5-abca-a961d422a39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70818e5f5f9d413293ebc8c2d2e5b18d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:07Z,use_quota=True,user_id='a35036b1aa0c4fa19a344def747a21e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Creating volume 10351a3c-c338-47e5-abca-a961d422a39c {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Deleted volume successfully. Aug 05 15:54:10 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c 1073741824 Aug 05 15:54:10 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f38dad8-b823-471a-a607-52f7586e2ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aab72f3-6073-4dd1-9c26-7aecba991afd', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82523d3-be8e-46b6-8273-02bc6d856cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Volume volume-7aab72f3-6073-4dd1-9c26-7aecba991afd (7aab72f3-6073-4dd1-9c26-7aecba991afd): created successfully Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82523d3-be8e-46b6-8273-02bc6d856cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (32d2263d-de17-4280-9fcc-837481dd7680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:10 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-79f00ffa-3424-4817-9abb-731a73a023f7 tempest-ProjectReaderTests-1700152490 None] Lock "cinder-44e8b32e-ab2d-47f4-8a7a-572c4df1ae54-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6f53adbc-1876-46c7-b0f5-6d53cd0e831a tempest-CreateVolumesFromImageTest-300201769 None] Created volume successfully. Aug 05 15:54:11 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c 1073741824" returned: 0 in 0.448s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:11 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c Aug 05 15:54:11 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:11 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c" returned: 0 in 0.268s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.780s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08abf6e4-f6ae-4676-96f7-7844c0d898ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10351a3c-c338-47e5-abca-a961d422a39c', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3ab036-73d2-4d66-93ba-c69f7c0d2684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Creating offline snapshot 8cb89c46-256a-420a-87b3-0282b0a6cb0c of volume 8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:11 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Volume volume-10351a3c-c338-47e5-abca-a961d422a39c (10351a3c-c338-47e5-abca-a961d422a39c): created successfully Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc3ab036-73d2-4d66-93ba-c69f7c0d2684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Flow 'volume_create_manager' (7aa6e6bd-93c7-4f38-b972-265b7c964e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7981f-be87-473a-a7bf-e05d0e11d30f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f2f18c96-45d4-4cae-8812-80c76dc174fe tempest-CreateVolumesFromImageTest-300201769 None] Created volume successfully. Aug 05 15:54:11 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e Aug 05 15:54:11 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e" returned: 0 in 0.383s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:12 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c 1G Aug 05 15:54:12 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c 1G" returned: 0 in 0.429s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4f449a-b8e1-4431-a056-62e0ca19705e -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:12 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4f449a-b8e1-4431-a056-62e0ca19705e -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c Aug 05 15:54:12 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b4f449a-b8e1-4431-a056-62e0ca19705e -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c" returned: 0 in 0.312s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:12 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c is being set with open permissions: ugo+rw Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:12 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c Aug 05 15:54:12 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-7aab72f3-6073-4dd1-9c26-7aecba991afd-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-7aab72f3-6073-4dd1-9c26-7aecba991afd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-quobyte-7aab72f3-6073-4dd1-9c26-7aecba991afd" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-7aab72f3-6073-4dd1-9c26-7aecba991afd" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7851eb1-b263-4750-b98b-8b952bf9de8b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd Aug 05 15:54:13 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info Aug 05 15:54:13 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd" returned: 0 in 0.356s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd Aug 05 15:54:13 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info" returned: 0 in 0.273s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info is being set with open permissions: ugo+rw Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info Aug 05 15:54:13 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7aab72f3-6073-4dd1-9c26-7aecba991afd" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-7aab72f3-6073-4dd1-9c26-7aecba991afd" released by "delete_volume" :: held 0.652s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Created reservations ['d213804a-4dae-4a29-8cf2-424eeb4f1cf5', 'e3e53407-cbeb-415a-bae4-e34e67849836', '2c1463a3-25b1-448e-9921-c8f0a38c388f', '256e3126-8838-48fc-b0db-92decc4d6760'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:13 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.info" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.061s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.795s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Creating offline snapshot 71726c9b-7c79-41f9-9733-3a11ae6317b6 of volume 97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a6187785-eeef-4a79-88b2-79e4b8c27bf6 tempest-VolumeDependencyTests-1374586020 None] Create snapshot completed successfully Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c631a3-1e65-49b4-839d-6612c71b6cbd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:13 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:13 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:13 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 Aug 05 15:54:13 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:14 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-7c3eb0a9-d5b4-443d-bed2-013199431451-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Deleted volume successfully. Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-7c3eb0a9-d5b4-443d-bed2-013199431451-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6488a40c-bc73-4668-b513-d937e2eb30d7 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-7aab72f3-6073-4dd1-9c26-7aecba991afd-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-quobyte-7c3eb0a9-d5b4-443d-bed2-013199431451" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-7c3eb0a9-d5b4-443d-bed2-013199431451" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fd2c52-7a7f-4255-b33f-ada21e501d4b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:14 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834" returned: 0 in 0.478s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:14 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 1G Aug 05 15:54:14 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:14 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 Aug 05 15:54:14 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:14 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451" returned: 0 in 0.381s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:14 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451 Aug 05 15:54:14 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:14 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 1G" returned: 0 in 0.487s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bc6774-ca50-4863-a2b1-f08c715a2834 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:14 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bc6774-ca50-4863-a2b1-f08c715a2834 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 Aug 05 15:54:14 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:14 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7c3eb0a9-d5b4-443d-bed2-013199431451" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Flow 'volume_create_manager' (525476ae-4700-4ca0-811f-a06e3e63e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812f6fb2-fca4-46ea-8001-957673e7d996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-7c3eb0a9-d5b4-443d-bed2-013199431451" released by "delete_volume" :: held 0.713s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812f6fb2-fca4-46ea-8001-957673e7d996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1479359281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e12dd86-5a5f-41b7-8ee9-9ef0083e061c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9d3dc2bfba54cf6b740682d8a2d573b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cb89c46-256a-420a-87b3-0282b0a6cb0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:15Z,use_quota=True,user_id='1dfcfca76256427ab879a68f6025edd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728e717e-b7b7-4669-a557-c30e0c91a8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728e717e-b7b7-4669-a557-c30e0c91a8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df684129-4ecf-4129-80f6-ec7109dd0552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df684129-4ecf-4129-80f6-ec7109dd0552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e12dd86-5a5f-41b7-8ee9-9ef0083e061c', 'volume_name': 'volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c', 'volume_size': 1, 'snapshot_id': '8cb89c46-256a-420a-87b3-0282b0a6cb0c'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5445610c-7af1-4ca2-98d1-277d6fe32995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5445610c-7af1-4ca2-98d1-277d6fe32995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761a7225-4c34-43a9-bba0-24db8c9712af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Volume 7e12dd86-5a5f-41b7-8ee9-9ef0083e061c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c', 'volume_size': 1, 'snapshot_id': '8cb89c46-256a-420a-87b3-0282b0a6cb0c'} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:14 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Created reservations ['acc45df7-4ed8-4bff-9117-250c041ff8eb', '7d4fb9d8-6036-48f4-ba58-3627d63cea16', '84ad7f95-7c14-474b-beed-80c36a92b625', 'eb4dc986-1dd1-44a0-b477-3274b65dfc33'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:15 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bc6774-ca50-4863-a2b1-f08c715a2834 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 is being set with open permissions: ugo+rw Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 Aug 05 15:54:15 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:15 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-10351a3c-c338-47e5-abca-a961d422a39c-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:15 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6" returned: 0 in 0.261s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-10351a3c-c338-47e5-abca-a961d422a39c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:15 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.273s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Deleted volume successfully. Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-quobyte-10351a3c-c338-47e5-abca-a961d422a39c" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:15 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info Aug 05 15:54:15 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-38017354-c424-4e72-bbcd-68a4a8265082 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-7c3eb0a9-d5b4-443d-bed2-013199431451-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-10351a3c-c338-47e5-abca-a961d422a39c" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c060bc7-1c8a-480b-9645-898c8d3a2aad]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c Aug 05 15:54:15 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info" returned: 0 in 0.283s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info is being set with open permissions: ugo+rw Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info Aug 05 15:54:15 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c" returned: 0 in 0.372s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:15 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c Aug 05 15:54:15 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:15 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.info" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.250s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-quobyte-8cb89c46-256a-420a-87b3-0282b0a6cb0c-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8cb89c46-256a-420a-87b3-0282b0a6cb0c-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Creating volume 7e12dd86-5a5f-41b7-8ee9-9ef0083e061c from snapshot 8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-quobyte-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-200fdb1e-2d28-4fa0-99ae-40d72302f821 tempest-CinderUnicodeTest-563852939 None] Create snapshot completed successfully Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] snapshot: 8cb89c46-256a-420a-87b3-0282b0a6cb0c, volume: 7e12dd86-5a5f-41b7-8ee9-9ef0083e061c, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bbe2a0-ff62-4b4b-9d8d-7c28f995382c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:16 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-10351a3c-c338-47e5-abca-a961d422a39c" returned: 0 in 0.301s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-10351a3c-c338-47e5-abca-a961d422a39c" released by "delete_volume" :: held 0.730s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-71726c9b-7c79-41f9-9733-3a11ae6317b6-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Lock "cinder-71726c9b-7c79-41f9-9733-3a11ae6317b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-quobyte-97bc6774-ca50-4863-a2b1-f08c715a2834" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:16 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c Aug 05 15:54:16 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-97bc6774-ca50-4863-a2b1-f08c715a2834" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-quobyte-71726c9b-7c79-41f9-9733-3a11ae6317b6" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-71726c9b-7c79-41f9-9733-3a11ae6317b6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Deleting offline snapshot 71726c9b-7c79-41f9-9733-3a11ae6317b6 of volume 97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] snapshot_file for this snap is: volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Created reservations ['de549d14-8a4a-4c08-b73f-4cb0d2686ccc', '1b0ac828-6d32-4e0c-9d78-64b5ce871657', '86c3b01e-44a6-4efe-8b2e-84d6115634f8', '16679731-de4e-4c96-b834-b37b1bb53d55'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdd4818-a5a6-4ca1-9bc5-d137e8b6b7a7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:16 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:16 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 Aug 05 15:54:16 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:16 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:16 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c" returned: 0 in 0.528s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4f449a-b8e1-4431-a056-62e0ca19705e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-quobyte-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f2a794-e330-48d7-b0be-cd129e201186]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8322da39-fbac-43ca-8ea9-9981d44cbef1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:16 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.354s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:16 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Deleted volume successfully. Aug 05 15:54:16 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e Aug 05 15:54:16 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-8837b574-872c-436d-a0e1-55529b8e9da3 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-10351a3c-c338-47e5-abca-a961d422a39c-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:16 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 Aug 05 15:54:16 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:16 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6" returned: 0 in 0.536s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bc6774-ca50-4863-a2b1-f08c715a2834(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f598ac9b-dd60-4a7f-b486-3dccc21774e5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:16 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 Aug 05 15:54:16 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:17 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e" returned: 0 in 0.428s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:17 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c Aug 05 15:54:17 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:17 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6" returned: 0 in 0.418s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:17 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6 Aug 05 15:54:17 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:17 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834" returned: 0 in 0.413s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:17 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 Aug 05 15:54:17 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:17 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6" released by "delete_volume" :: held 0.771s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Created reservations ['42d4a2c7-86f5-4a04-8cc9-0796d24b8001', 'c3089189-9447-43b8-a387-247cf3edc54d', '4e25b6ca-a86e-4b02-b0e2-ac73ec8cf495', 'a153850d-ad24-4e2b-be6f-49cd34160181'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:17 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:17 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-ecc08003-75d3-479a-993b-7469a28fe570-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-ecc08003-75d3-479a-993b-7469a28fe570-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:18 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6" returned: 0 in 0.781s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:18 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6 Aug 05 15:54:18 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "cinder-quobyte-ecc08003-75d3-479a-993b-7469a28fe570" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-ecc08003-75d3-479a-993b-7469a28fe570" acquired by "delete_volume" :: waited 0.070s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:18 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.785s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Deleted volume successfully. Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9dcced-23cf-4233-b054-b316f2ab239d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f0fec941-7c4d-44fb-ac6c-981bb30886ba tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-3007cdbb-d323-4ee3-987f-0b4f8f90fdc6-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:18 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 Aug 05 15:54:18 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:19 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:19 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570" returned: 0 in 0.655s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834.71726c9b-7c79-41f9-9733-3a11ae6317b6" returned: 0 in 1.034s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:19 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570 Aug 05 15:54:19 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-71726c9b-7c79-41f9-9733-3a11ae6317b6" released by "_delete_snapshot" :: held 2.998s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-97bc6774-ca50-4863-a2b1-f08c715a2834" released by "delete_snapshot" :: held 3.044s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Created reservations ['e6cb5744-ee8e-4993-aafc-c126d8cf00fc', '18cca7f2-00c7-4696-9b21-3d66da739bbb', '07241f32-e82a-4c30-bb4e-aa22b0dc9dcb', 'de6809b3-c94c-42d5-a032-a15e01477e00'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:19 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Delete snapshot completed successfully. Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c17a98e7-5751-469d-b3df-1bce8dd6917d tempest-CinderUnicodeTest-563852939 None] Lock "cinder-71726c9b-7c79-41f9-9733-3a11ae6317b6-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:19 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ecc08003-75d3-479a-993b-7469a28fe570" returned: 0 in 0.705s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-quobyte-ecc08003-75d3-479a-993b-7469a28fe570" released by "delete_volume" :: held 1.500s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:19 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Created reservations ['022f75b7-1825-4d0c-a3d9-41a4e69a36cd', '69769be0-a640-45f7-b933-ab03f6d2fd07', '9f701398-c927-46f6-b603-6743ba62131b', 'ef6f76c9-3961-439c-960a-87ecae5d6d21'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:20 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:20 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-97bc6774-ca50-4863-a2b1-f08c715a2834-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-97bc6774-ca50-4863-a2b1-f08c715a2834-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-quobyte-97bc6774-ca50-4863-a2b1-f08c715a2834" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:20 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.818s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Deleted volume successfully. Aug 05 15:54:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-97bc6774-ca50-4863-a2b1-f08c715a2834" acquired by "delete_volume" :: waited 0.090s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6664507f-1d01-49b9-934c-6f8bf17f0604 tempest-CreateVolumesFromImageTest-300201769 None] Lock "cinder-ecc08003-75d3-479a-993b-7469a28fe570-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c2322-1db0-4803-9988-929d08129c8e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:21 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 Aug 05 15:54:21 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:22 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834" returned: 0 in 1.200s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:22 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834 Aug 05 15:54:22 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:22 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" returned: 0 in 5.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:54:22 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Converted 1024.00 MB image at 189.86 MB/s Aug 05 15:54:22 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c is being set with open permissions: ugo+rw Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:22 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c Aug 05 15:54:22 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:22 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-97bc6774-ca50-4863-a2b1-f08c715a2834" returned: 0 in 0.343s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-97bc6774-ca50-4863-a2b1-f08c715a2834" released by "delete_volume" :: held 1.707s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Created reservations ['9e7f286e-5c55-468a-869f-9f7cb0f1a3d9', '3b720511-d9d9-4c6c-9d14-1af125567ec2', '92b4c84f-d35f-4227-b3d2-55bd5b043253', '7658e5b0-b585-494e-9bdd-a1071a903a14'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:22 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" returned: 0 in 0.295s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" released by "_copy_volume_from_snapshot" :: held 6.754s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8cb89c46-256a-420a-87b3-0282b0a6cb0c-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" released by "_create_volume_from_snapshot" :: held 6.851s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.884s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:22 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:22 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (761a7225-4c34-43a9-bba0-24db8c9712af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c', 'volume_size': 1, 'snapshot_id': '8cb89c46-256a-420a-87b3-0282b0a6cb0c'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e47ede6-3436-48df-b72a-e1acebdb5e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:22 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Volume volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c (7e12dd86-5a5f-41b7-8ee9-9ef0083e061c): created successfully Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e47ede6-3436-48df-b72a-e1acebdb5e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:22 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Flow 'volume_create_manager' (525476ae-4700-4ca0-811f-a06e3e63e227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-06fe1af8-14bf-44c2-a91a-f0dc94a00a27 tempest-VolumeDependencyTests-1374586020 None] Created volume successfully. Aug 05 15:54:23 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.253s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Deleted volume successfully. Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-ca188b72-5f11-4bd1-b05e-6a61ff48cb53 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-97bc6774-ca50-4863-a2b1-f08c715a2834-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-7165a5b5-d720-4342-8ee7-0ce880e25cbe-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-7165a5b5-d720-4342-8ee7-0ce880e25cbe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "cinder-quobyte-7165a5b5-d720-4342-8ee7-0ce880e25cbe" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-7165a5b5-d720-4342-8ee7-0ce880e25cbe" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[704285f2-a0d4-4f05-95c7-a1aa464a5377]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:23 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe Aug 05 15:54:23 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:23 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe" returned: 0 in 0.380s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-8cb89c46-256a-420a-87b3-0282b0a6cb0c-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:23 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe Aug 05 15:54:23 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-8cb89c46-256a-420a-87b3-0282b0a6cb0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-quobyte-8b4f449a-b8e1-4431-a056-62e0ca19705e" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8b4f449a-b8e1-4431-a056-62e0ca19705e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-quobyte-8cb89c46-256a-420a-87b3-0282b0a6cb0c" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8cb89c46-256a-420a-87b3-0282b0a6cb0c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Deleting offline snapshot 8cb89c46-256a-420a-87b3-0282b0a6cb0c of volume 8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] snapshot_file for this snap is: volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[686387d1-9d08-4444-bb2b-cf87afd9e27c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:23 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c Aug 05 15:54:23 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:23 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7165a5b5-d720-4342-8ee7-0ce880e25cbe" returned: 0 in 0.284s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-quobyte-7165a5b5-d720-4342-8ee7-0ce880e25cbe" released by "delete_volume" :: held 0.707s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Created reservations ['b223267a-c6f8-4ded-b741-24b5b1c2f3ff', '41e4de63-efe9-41d9-b13a-2c6dbdd1f316', 'b52c90b5-47c2-41aa-b766-6b938ba63e27', '97e0a36c-8e6b-4467-8a1c-e568bcd40825'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:24 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:24 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:24 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c" returned: 0 in 0.372s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b4f449a-b8e1-4431-a056-62e0ca19705e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90b104-1e77-420d-a7ee-093b2bfbee17]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:24 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e Aug 05 15:54:24 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:24 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.300s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:24 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Deleted volume successfully. Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-90a5e532-a73e-4748-b86b-a30b7bebeb97 tempest-CinderUnicodeTest-563852939 None] Lock "cinder-7165a5b5-d720-4342-8ee7-0ce880e25cbe-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (06d25fef-21c3-438c-b4d2-5a74cbfcbfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe787ae6-5cbb-4936-8375-8de890c9f33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe787ae6-5cbb-4936-8375-8de890c9f33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463065991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef42f5a5-6799-4e0b-9f34-6685b5193a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:25Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a93f8f-1fb4-4fc5-9dd3-82573ee98ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a93f8f-1fb4-4fc5-9dd3-82573ee98ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76029ea-75b5-47d7-b091-5f0412034899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b76029ea-75b5-47d7-b091-5f0412034899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef42f5a5-6799-4e0b-9f34-6685b5193a2d', 'volume_name': 'volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec5d38e-f0d2-4fa5-83e4-676fe0acbe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec5d38e-f0d2-4fa5-83e4-676fe0acbe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e149250b-b029-4a14-9237-2599b37eae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:24 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume ef42f5a5-6799-4e0b-9f34-6685b5193a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d', 'volume_size': 1} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-463065991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef42f5a5-6799-4e0b-9f34-6685b5193a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:25Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating volume ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:24 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e" returned: 0 in 0.683s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:24 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d 1073741824 Aug 05 15:54:24 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:24 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c Aug 05 15:54:24 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:25 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c" returned: 0 in 0.389s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:25 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c Aug 05 15:54:25 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:25 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d 1073741824" returned: 0 in 0.513s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:25 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d Aug 05 15:54:25 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:25 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e.8cb89c46-256a-420a-87b3-0282b0a6cb0c" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8cb89c46-256a-420a-87b3-0282b0a6cb0c" released by "_delete_snapshot" :: held 1.847s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8b4f449a-b8e1-4431-a056-62e0ca19705e" released by "delete_snapshot" :: held 1.881s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Created reservations ['6a45f4e5-04c2-4d20-a867-db678a08a1b4', '506cedb5-1edd-4cd9-989a-a253100b8f0b', '39b34d8c-eedb-4da0-a218-39512ac47051', 'a2579661-9c07-4560-af35-558eae4e8311'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:25 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" returned: 0 in 0.314s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e149250b-b029-4a14-9237-2599b37eae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70d49eb-e5f4-4ed7-9afd-0d17c6768543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:25 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d (ef42f5a5-6799-4e0b-9f34-6685b5193a2d): created successfully Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70d49eb-e5f4-4ed7-9afd-0d17c6768543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (06d25fef-21c3-438c-b4d2-5a74cbfcbfaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ac437e37-d6b7-4956-b41f-1af40691664a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created volume successfully. Aug 05 15:54:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Delete snapshot completed successfully. Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b2d58bad-33c7-41bf-897e-1cd25df143ac tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-8cb89c46-256a-420a-87b3-0282b0a6cb0c-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-8b4f449a-b8e1-4431-a056-62e0ca19705e-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-8b4f449a-b8e1-4431-a056-62e0ca19705e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-quobyte-8b4f449a-b8e1-4431-a056-62e0ca19705e" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8b4f449a-b8e1-4431-a056-62e0ca19705e" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf91e3b-7b29-4741-8c68-edb69d66af7e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e Aug 05 15:54:26 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:26 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e" returned: 0 in 0.401s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e Aug 05 15:54:26 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:26 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-8b4f449a-b8e1-4431-a056-62e0ca19705e" returned: 0 in 0.256s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-8b4f449a-b8e1-4431-a056-62e0ca19705e" released by "delete_volume" :: held 0.735s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Created reservations ['9dec957c-f329-4c34-92d8-709f59d68e35', '9e250794-8b9a-4ff0-b343-d5b4309a911b', '7c1613b9-1bb6-4fec-81f5-1d4ae0d570a4', 'd6059c67-6482-47a2-8d9f-39c78fa3880d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:26 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:26 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating offline snapshot 52fa19c6-397b-486a-90f7-65ab4a4d9918 of volume ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce70e55-0891-4d92-b3f6-cc2bca2a5eba]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "cinder-quobyte-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:27 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.348s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" acquired by "delete_volume" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:27 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Deleted volume successfully. Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-c6b653bf-8e20-4719-a073-729ef8c07ca6 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-8b4f449a-b8e1-4431-a056-62e0ca19705e-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f25821-5897-4328-964d-a892628648a7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d Aug 05 15:54:27 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c Aug 05 15:54:27 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" returned: 0 in 0.428s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 1G Aug 05 15:54:27 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" returned: 0 in 0.396s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:27 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c Aug 05 15:54:27 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:27 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" returned: 0 in 0.261s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-db5dfda8-41bd-4634-ab54-7281caf05eac tempest-ProjectAdminTests-2035129458 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6940155029297, 'free_capacity_gb': 1775.6940155029297, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88999) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 05 15:54:27 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-quobyte-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c" released by "delete_volume" :: held 0.720s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Created reservations ['82ff82cc-fa1e-4d22-a91f-b48dbd9b136e', '8d8cd18c-48d0-41ae-b75f-2c59a7ce08f2', 'e79e6f7a-a855-4d75-a041-1d31e54957ef', '2abbfc57-4612-4f24-8760-f7573e20ac36'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:28 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 1G" returned: 0 in 0.468s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:28 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 Aug 05 15:54:28 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:28 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:28 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:28 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.262s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:28 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Deleted volume successfully. Aug 05 15:54:28 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 is being set with open permissions: ugo+rw Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-33cf607e-fdeb-4f60-9af7-c4e0b36a6b74 tempest-VolumeDependencyTests-1374586020 None] Lock "cinder-7e12dd86-5a5f-41b7-8ee9-9ef0083e061c-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:28 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 Aug 05 15:54:28 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:28 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918" returned: 0 in 0.251s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:28 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info Aug 05 15:54:28 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:28 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:28 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info is being set with open permissions: ugo+rw Aug 05 15:54:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:29 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info Aug 05 15:54:29 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:29 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.info" returned: 0 in 0.310s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:29 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d9806fe8-dc85-4339-994c-bd03944696a4 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Create snapshot completed successfully Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (a85456e1-066d-4392-9fa2-fac1a70de71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523aff6f-0f4b-4cfa-bfb8-44127c6e08ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (523aff6f-0f4b-4cfa-bfb8-44127c6e08ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451260904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5150f8da-2814-40cb-9d5f-b275ea3a405d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:31Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241a9557-0df2-4c2a-be90-d3f5b659d59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241a9557-0df2-4c2a-be90-d3f5b659d59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b853176-ba9c-40e0-a9a3-07227f5fa510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b853176-ba9c-40e0-a9a3-07227f5fa510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5150f8da-2814-40cb-9d5f-b275ea3a405d', 'volume_name': 'volume-5150f8da-2814-40cb-9d5f-b275ea3a405d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dc75b0-0084-47dc-a114-922344977bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6dc75b0-0084-47dc-a114-922344977bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63db79ca-3842-4be0-92cb-da90b26e7e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:30 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume 5150f8da-2814-40cb-9d5f-b275ea3a405d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5150f8da-2814-40cb-9d5f-b275ea3a405d', 'volume_size': 1} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-451260904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5150f8da-2814-40cb-9d5f-b275ea3a405d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:31Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating volume 5150f8da-2814-40cb-9d5f-b275ea3a405d {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:30 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:30 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d 1073741824 Aug 05 15:54:30 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (bbc8f863-af54-4c87-8eba-2ebc7ae798d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69687d42-f632-4a0d-91d7-1b8c1f6aebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69687d42-f632-4a0d-91d7-1b8c1f6aebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829963026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab57687-ab59-436b-b836-5ed76c6e0873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:31Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08345414-aea3-4df1-bb79-c3d0a930af65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08345414-aea3-4df1-bb79-c3d0a930af65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72b7921-1663-4b45-ba3f-aa674207751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72b7921-1663-4b45-ba3f-aa674207751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ab57687-ab59-436b-b836-5ed76c6e0873', 'volume_name': 'volume-3ab57687-ab59-436b-b836-5ed76c6e0873', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e572d-f2eb-4377-81bd-6f6df6c20019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08e572d-f2eb-4377-81bd-6f6df6c20019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1788e574-32b5-4bf8-bba6-3525eb2f24f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume 3ab57687-ab59-436b-b836-5ed76c6e0873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ab57687-ab59-436b-b836-5ed76c6e0873', 'volume_size': 1} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:31 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d 1073741824" returned: 0 in 0.704s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:31 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d Aug 05 15:54:31 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (c1eead53-dcde-49c8-8ca9-8f378cd70392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6622ec0a-08c6-4eac-a183-2ae503f7b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6622ec0a-08c6-4eac-a183-2ae503f7b182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237360977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a580d18e-1507-4cb2-9f55-b3b2cbc63bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:32Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88386c9-f420-491f-9d0f-c0cca1cb6bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88386c9-f420-491f-9d0f-c0cca1cb6bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:31 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d582fcda-6f39-4a5f-96f7-8c32bf84b25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d582fcda-6f39-4a5f-96f7-8c32bf84b25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a580d18e-1507-4cb2-9f55-b3b2cbc63bc1', 'volume_name': 'volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a78538e-a48e-4b37-80c3-bc54358f50f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a78538e-a48e-4b37-80c3-bc54358f50f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad50669-2e75-49a3-9ea6-50c9c4e307ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume a580d18e-1507-4cb2-9f55-b3b2cbc63bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1', 'volume_size': 1} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:32 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d" returned: 0 in 0.478s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.557s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829963026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab57687-ab59-436b-b836-5ed76c6e0873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:31Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating volume 3ab57687-ab59-436b-b836-5ed76c6e0873 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:32 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63db79ca-3842-4be0-92cb-da90b26e7e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5150f8da-2814-40cb-9d5f-b275ea3a405d', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 1073741824 Aug 05 15:54:32 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa40ff21-73ef-4831-962a-d65c583d1a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume volume-5150f8da-2814-40cb-9d5f-b275ea3a405d (5150f8da-2814-40cb-9d5f-b275ea3a405d): created successfully Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa40ff21-73ef-4831-962a-d65c583d1a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (a85456e1-066d-4392-9fa2-fac1a70de71a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:32 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-02bfb884-795c-4546-8720-8e795f963e3a tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created volume successfully. Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (44833e28-9076-4c31-8dda-6d361dad899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aae026-463a-4696-91f6-bda9654e1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18aae026-463a-4696-91f6-bda9654e1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075800808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19832939-2ebe-40f1-9550-53394cb806e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:32Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147bcfe0-4ee6-43bb-820e-d650a53ac350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (147bcfe0-4ee6-43bb-820e-d650a53ac350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d173602b-687f-447e-974a-5641b94a7f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d173602b-687f-447e-974a-5641b94a7f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19832939-2ebe-40f1-9550-53394cb806e8', 'volume_name': 'volume-19832939-2ebe-40f1-9550-53394cb806e8', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953ae17-7ca9-4917-ba08-2004fdee463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7953ae17-7ca9-4917-ba08-2004fdee463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4b882d-365c-4d93-b59f-af4955379bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume 19832939-2ebe-40f1-9550-53394cb806e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19832939-2ebe-40f1-9550-53394cb806e8', 'volume_size': 1} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (830e6eec-1751-4262-9343-9944abb6641a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28af021f-3fa2-4bc1-a9be-5bed911f92d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28af021f-3fa2-4bc1-a9be-5bed911f92d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236432568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbce93b2-47cf-424e-a8f3-6284a559342b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:33Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349ec23d-4063-4771-8a7c-38b9cab531cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (349ec23d-4063-4771-8a7c-38b9cab531cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5416b159-199c-4a8b-9de0-ef5eb7584bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5416b159-199c-4a8b-9de0-ef5eb7584bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbce93b2-47cf-424e-a8f3-6284a559342b', 'volume_name': 'volume-dbce93b2-47cf-424e-a8f3-6284a559342b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597b8f96-65dc-4051-b04f-54b39254ee77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597b8f96-65dc-4051-b04f-54b39254ee77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bb72a0-2c8e-4d71-a1d1-656128a0573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:32 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume dbce93b2-47cf-424e-a8f3-6284a559342b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbce93b2-47cf-424e-a8f3-6284a559342b', 'volume_size': 1} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:32 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 1073741824" returned: 0 in 0.705s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:32 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 Aug 05 15:54:32 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:33 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-237360977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a580d18e-1507-4cb2-9f55-b3b2cbc63bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:32Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating volume a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:33 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1788e574-32b5-4bf8-bba6-3525eb2f24f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab57687-ab59-436b-b836-5ed76c6e0873', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:33 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 1073741824 Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1643d2e9-d415-4d69-8e4c-cb32c0e3ada9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:33 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:33 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume volume-3ab57687-ab59-436b-b836-5ed76c6e0873 (3ab57687-ab59-436b-b836-5ed76c6e0873): created successfully Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1643d2e9-d415-4d69-8e4c-cb32c0e3ada9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (bbc8f863-af54-4c87-8eba-2ebc7ae798d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-15075db6-b33c-4503-b4d5-12916bf5bc21 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created volume successfully. Aug 05 15:54:33 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 1073741824" returned: 0 in 0.555s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=211,cinder:UPDATE=253,cinder:DELETE=26,cinder:INSERT=63 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:54:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:33 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 Aug 05 15:54:33 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:34 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.544s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2075800808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19832939-2ebe-40f1-9550-53394cb806e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:32Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating volume 19832939-2ebe-40f1-9550-53394cb806e8 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:34 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad50669-2e75-49a3-9ea6-50c9c4e307ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:34 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 1073741824 Aug 05 15:54:34 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabf829e-0611-4020-95a3-e4c9bba3e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:34 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 (a580d18e-1507-4cb2-9f55-b3b2cbc63bc1): created successfully Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabf829e-0611-4020-95a3-e4c9bba3e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (c1eead53-dcde-49c8-8ca9-8f378cd70392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-75293e02-d803-4ddf-9201-2cbcb9c62614 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created volume successfully. Aug 05 15:54:34 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 1073741824" returned: 0 in 0.492s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:34 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 Aug 05 15:54:34 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:34 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8" returned: 0 in 0.316s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.146s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1236432568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbce93b2-47cf-424e-a8f3-6284a559342b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087cbb64e2e745aba5f2baa8a7c1eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:33Z,use_quota=True,user_id='8045cabf161d49cdbf4b28759358bf7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Creating volume dbce93b2-47cf-424e-a8f3-6284a559342b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:34 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4b882d-365c-4d93-b59f-af4955379bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19832939-2ebe-40f1-9550-53394cb806e8', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:35 devstack sudo[108194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b 1073741824 Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5e00b3-88d2-4321-99f6-c1dac3f6fde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:35 devstack sudo[108194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume volume-19832939-2ebe-40f1-9550-53394cb806e8 (19832939-2ebe-40f1-9550-53394cb806e8): created successfully Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf5e00b3-88d2-4321-99f6-c1dac3f6fde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (44833e28-9076-4c31-8dda-6d361dad899d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ea50e93e-e6b5-4e94-ad1b-ac3ad8d4d610 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created volume successfully. Aug 05 15:54:35 devstack sudo[108194]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b 1073741824" returned: 0 in 0.559s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:35 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b Aug 05 15:54:35 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:35 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b" returned: 0 in 0.269s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bb72a0-2c8e-4d71-a1d1-656128a0573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbce93b2-47cf-424e-a8f3-6284a559342b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabaa9f9-9821-4dcd-8cee-bb98d55d21c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Volume volume-dbce93b2-47cf-424e-a8f3-6284a559342b (dbce93b2-47cf-424e-a8f3-6284a559342b): created successfully Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabaa9f9-9821-4dcd-8cee-bb98d55d21c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Flow 'volume_create_manager' (830e6eec-1751-4262-9343-9944abb6641a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:35 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2e8eb747-c553-4663-b2ec-04a61a2088c0 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created volume successfully. Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-dbce93b2-47cf-424e-a8f3-6284a559342b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-dbce93b2-47cf-424e-a8f3-6284a559342b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-dbce93b2-47cf-424e-a8f3-6284a559342b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-dbce93b2-47cf-424e-a8f3-6284a559342b" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c1917-fa0c-4492-a7c7-6d6080b93cc4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:36 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b Aug 05 15:54:36 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:36 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b" returned: 0 in 0.393s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:36 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b Aug 05 15:54:36 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:37 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-dbce93b2-47cf-424e-a8f3-6284a559342b" returned: 0 in 0.306s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-dbce93b2-47cf-424e-a8f3-6284a559342b" released by "delete_volume" :: held 0.741s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['e93eaa69-5438-41bd-9fec-d96d21451131', '07c0ec12-e29b-4dc8-8bf8-ea8bc9d7624c', '727eb050-445c-4565-a40d-e70a88f03006', 'c86bde4c-9704-4414-8edd-28ca46d9214b'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:37 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:37 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-19832939-2ebe-40f1-9550-53394cb806e8-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-19832939-2ebe-40f1-9550-53394cb806e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:37 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-19832939-2ebe-40f1-9550-53394cb806e8" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.318s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:37 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleted volume successfully. Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-19832939-2ebe-40f1-9550-53394cb806e8" acquired by "delete_volume" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-7ae6ebf5-7bf0-45c4-bd1d-1154b7332633 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-dbce93b2-47cf-424e-a8f3-6284a559342b-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7363d64-a166-4348-8475-7a177abdbf55]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:37 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 Aug 05 15:54:37 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:38 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8" returned: 0 in 0.410s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:38 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8 Aug 05 15:54:38 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:38 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-19832939-2ebe-40f1-9550-53394cb806e8" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-19832939-2ebe-40f1-9550-53394cb806e8" released by "delete_volume" :: held 0.796s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['e7356f59-9186-4021-8ebd-da9a5127fa4f', 'ddc92aa2-d6c9-4f2d-9b5b-9cf33c7fcd3d', '7a2b082b-96e4-422b-8c9d-d9ae67d0fa43', '971c2dd3-d639-4713-937a-492115109e1c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:38 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:38 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (f73db693-d929-4bb8-85bd-840199547d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ceaf94e-8e3b-4fd6-a235-8055a300e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ceaf94e-8e3b-4fd6-a235-8055a300e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970905953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d76eb39-eb79-4abb-875b-ff206f5f7dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:38Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a9bfab-c9f9-4c5c-b50b-9101b3134b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a9bfab-c9f9-4c5c-b50b-9101b3134b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a049cf-40a2-42ab-aa72-01542a546391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a049cf-40a2-42ab-aa72-01542a546391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d76eb39-eb79-4abb-875b-ff206f5f7dc9', 'volume_name': 'volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442cc58-8dcf-4100-8808-54a6898410b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2442cc58-8dcf-4100-8808-54a6898410b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4baaa60-55dd-48a7-aa68-30354963bd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:38 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Volume 7d76eb39-eb79-4abb-875b-ff206f5f7dc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9', 'volume_size': 1} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1970905953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d76eb39-eb79-4abb-875b-ff206f5f7dc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:38Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Creating volume 7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:38 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:38 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 1073741824 Aug 05 15:54:38 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc0437b-d247-4135-9a3f-96c2ed7371c8]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:38 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.322s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:38 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleted volume successfully. Aug 05 15:54:38 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-d8585077-8d5b-4fe3-a7c9-f825e9d036d6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-19832939-2ebe-40f1-9550-53394cb806e8-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:38 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 Aug 05 15:54:38 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:39 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 1073741824" returned: 0 in 0.478s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:39 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 Aug 05 15:54:39 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:39 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1" returned: 0 in 0.385s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:39 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1 Aug 05 15:54:39 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:39 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" returned: 0 in 0.276s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4baaa60-55dd-48a7-aa68-30354963bd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87aabc66-90cb-48d8-ab3d-1083af7b6e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:39 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Volume volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 (7d76eb39-eb79-4abb-875b-ff206f5f7dc9): created successfully Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87aabc66-90cb-48d8-ab3d-1083af7b6e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (f73db693-d929-4bb8-85bd-840199547d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:39 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1" released by "delete_volume" :: held 0.730s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e1a9af7e-2d43-44fe-939b-7496e26ffb52 tempest-ProjectReaderTests-1407980028 None] Created volume successfully. Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['f68a1569-6e6c-4240-ae4a-40296d65f3d0', '4902cd7f-a3d9-4e06-90c6-379a61690628', 'cdff3127-dbfa-4e9e-87cc-585e05ba84a0', '7a7236f6-e6a7-4a9a-ac96-f18a84ebe873'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:39 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:39 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-3ab57687-ab59-436b-b836-5ed76c6e0873-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-3ab57687-ab59-436b-b836-5ed76c6e0873-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:39 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.272s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-3ab57687-ab59-436b-b836-5ed76c6e0873" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleted volume successfully. Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-3ab57687-ab59-436b-b836-5ed76c6e0873" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-687fb99c-f1b7-4cbb-8843-64776568d714 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-a580d18e-1507-4cb2-9f55-b3b2cbc63bc1-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb767c5-f05e-42bc-8784-4d0d55487685]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:40 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 Aug 05 15:54:40 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:40 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873" returned: 0 in 0.376s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:40 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873 Aug 05 15:54:40 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Creating offline snapshot 23bb087c-1127-4d26-83e1-9b32ef17ab62 of volume 7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:40 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f5d995-c523-46d6-a691-19077a4efc2b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-3ab57687-ab59-436b-b836-5ed76c6e0873" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-3ab57687-ab59-436b-b836-5ed76c6e0873" released by "delete_volume" :: held 0.718s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['ba395311-aec2-4423-b4f1-b6a3f17ae029', 'b5ee4906-0411-4418-95d0-8dfad175e7bc', '76477800-826e-4649-aca4-7217a1036f87', 'd9dcecbf-dd9c-4bd3-8d80-101d5f23c021'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:40 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 Aug 05 15:54:40 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:40 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:40 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-5150f8da-2814-40cb-9d5f-b275ea3a405d-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:41 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleted volume successfully. Aug 05 15:54:41 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 1G Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-5150f8da-2814-40cb-9d5f-b275ea3a405d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:41 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-99309166-bc9b-4e42-9eca-d178c4b3d246 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-3ab57687-ab59-436b-b836-5ed76c6e0873-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-5150f8da-2814-40cb-9d5f-b275ea3a405d" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-5150f8da-2814-40cb-9d5f-b275ea3a405d" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a60784-e26a-429b-a0b7-478e155f86e4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d Aug 05 15:54:41 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 1G" returned: 0 in 0.460s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 Aug 05 15:54:41 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d" returned: 0 in 0.412s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d Aug 05 15:54:41 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 is being set with open permissions: ugo+rw Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:41 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-5150f8da-2814-40cb-9d5f-b275ea3a405d" returned: 0 in 0.319s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:41 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 Aug 05 15:54:41 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-5150f8da-2814-40cb-9d5f-b275ea3a405d" released by "delete_volume" :: held 0.779s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:41 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['f8f5ba2e-3f5e-4184-90c3-c54772f8770c', '5e18783a-f789-4812-9436-e80e3956461e', 'b67352ee-6ab6-4fcb-a786-40f440529bda', 'c41507d5-720a-4d14-bbce-be69407d83fd'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:42 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:42 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:42 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62" returned: 0 in 0.292s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:42 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info Aug 05 15:54:42 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-52fa19c6-397b-486a-90f7-65ab4a4d9918-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-52fa19c6-397b-486a-90f7-65ab4a4d9918-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-52fa19c6-397b-486a-90f7-65ab4a4d9918" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-52fa19c6-397b-486a-90f7-65ab4a4d9918" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleting offline snapshot 52fa19c6-397b-486a-90f7-65ab4a4d9918 of volume ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] snapshot_file for this snap is: volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2283764-f025-4df2-86b8-c21e9ff3067e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:42 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.361s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleted volume successfully. Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-038fa46c-6ba6-4368-924e-011c89548732 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-5150f8da-2814-40cb-9d5f-b275ea3a405d-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:42 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info" returned: 0 in 0.369s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:42 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info is being set with open permissions: ugo+rw Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:42 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 Aug 05 15:54:42 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:42 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info Aug 05 15:54:42 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:42 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.info" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:42 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918" returned: 0 in 0.423s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8196e6f6-a5c3-4522-9ff1-79eb96e1ddc2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-41f35a7c-6390-450d-b4a8-5aa19f5fa259 tempest-ProjectReaderTests-1407980028 None] Create snapshot completed successfully Aug 05 15:54:43 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d Aug 05 15:54:43 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:43 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" returned: 0 in 0.379s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:43 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 Aug 05 15:54:43 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:43 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918" returned: 0 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:43 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918 Aug 05 15:54:43 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-23bb087c-1127-4d26-83e1-9b32ef17ab62-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:43 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d.52fa19c6-397b-486a-90f7-65ab4a4d9918" returned: 0 in 0.291s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=205,cinder:INSERT=89,cinder:UPDATE=316,cinder:DELETE=28 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Lock "cinder-23bb087c-1127-4d26-83e1-9b32ef17ab62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-52fa19c6-397b-486a-90f7-65ab4a4d9918" released by "_delete_snapshot" :: held 1.617s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" released by "delete_snapshot" :: held 1.662s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-23bb087c-1127-4d26-83e1-9b32ef17ab62" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-23bb087c-1127-4d26-83e1-9b32ef17ab62" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Deleting offline snapshot 23bb087c-1127-4d26-83e1-9b32ef17ab62 of volume 7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] snapshot_file for this snap is: volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[345a6606-b2be-4990-844b-1058a7ca3b4d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['53e8f5b7-7d79-4eb9-8b6c-cc1a6406fe3e', '1fcd25e9-1ac9-49c0-b346-978aebbbd7d4', '110152bf-a481-4d12-acbc-716ebe3f98b6', '3790c6ea-3c90-43c1-bea5-d32d268e5fe2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Delete snapshot completed successfully. Aug 05 15:54:44 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 Aug 05 15:54:44 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-539654d4-890a-4eba-a423-7950625a15f6 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-52fa19c6-397b-486a-90f7-65ab4a4d9918-delete_snapshot" released by "delete_snapshot" :: held 1.903s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-ef42f5a5-6799-4e0b-9f34-6685b5193a2d-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:44 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62" returned: 0 in 0.437s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-ef42f5a5-6799-4e0b-9f34-6685b5193a2d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a43af4-913d-4398-ab06-ef3c805048d7]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "cinder-quobyte-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd05e4f-1bee-483e-b460-9e72befa3567]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:44 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 Aug 05 15:54:44 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:44 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d Aug 05 15:54:44 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" returned: 0 in 0.445s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 Aug 05 15:54:45 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" returned: 0 in 0.437s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d Aug 05 15:54:45 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" returned: 0 in 0.262s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62" returned: 0 in 0.395s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-quobyte-ef42f5a5-6799-4e0b-9f34-6685b5193a2d" released by "delete_volume" :: held 0.796s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:45 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62 Aug 05 15:54:45 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Created reservations ['b7644575-af01-4472-a26b-9d0e7e2a37d4', '1e0a5fda-7098-411e-b6ef-54509f329bb5', '58a3634a-5013-473c-ad43-1d7796bfbce8', 'b7a57328-9244-423a-8ef2-349d40553e62'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:45 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:45 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:45 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9.23bb087c-1127-4d26-83e1-9b32ef17ab62" returned: 0 in 0.331s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-23bb087c-1127-4d26-83e1-9b32ef17ab62" released by "_delete_snapshot" :: held 1.734s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" released by "delete_snapshot" :: held 1.766s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:45 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Deleted volume successfully. Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Created reservations ['aeaa925d-f471-4386-b09c-f186f175f1a6', '23bc4258-a183-4e58-9a8c-6489ba0a7560', '13740677-5772-4a3e-9d77-94dc31aeb692', '13aaf029-99e6-4baa-8741-7c7d0045d21d'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eb64c6d3-f0a2-4f48-9f86-2bb005a76668 tempest-CreateVolumesFromSnapshotTest-2130988935 None] Lock "cinder-ef42f5a5-6799-4e0b-9f34-6685b5193a2d-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Delete snapshot completed successfully. Aug 05 15:54:45 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-66f2bc1b-28f6-4794-8242-062d058c937b tempest-ProjectReaderTests-1407980028 None] Lock "cinder-23bb087c-1127-4d26-83e1-9b32ef17ab62-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-7d76eb39-eb79-4abb-875b-ff206f5f7dc9-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-7d76eb39-eb79-4abb-875b-ff206f5f7dc9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d257bb8-3ab3-4249-a568-23aab67c2598]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:46 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 Aug 05 15:54:46 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:46 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" returned: 0 in 0.428s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:46 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9 Aug 05 15:54:46 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:46 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:46 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-7d76eb39-eb79-4abb-875b-ff206f5f7dc9" released by "delete_volume" :: held 0.781s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Created reservations ['eb4e74c8-9b73-4652-81f7-515141ac92c5', 'b8b69b9f-f81e-4823-af11-d273cf7c80c8', '34a78954-a5a1-4c9b-8f22-1b61d265a59d', '4f11d45f-f821-45f2-980e-4d3db53c604c'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:47 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:47 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:47 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.346s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:47 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Deleted volume successfully. Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e7c0c01d-b89a-4f33-afb0-e239458f35b2 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-7d76eb39-eb79-4abb-875b-ff206f5f7dc9-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (0a3f8042-da94-48af-bd34-f6f2419eed7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8cc6f1-612f-455e-b495-376075cd2764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8cc6f1-612f-455e-b495-376075cd2764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296317532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b15173-1038-4216-be87-a37e68895c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:48Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547c1a57-f240-41c7-bc7e-6d3893fb4ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547c1a57-f240-41c7-bc7e-6d3893fb4ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74581f0-d49a-4ab4-8fd0-78193bc57938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74581f0-d49a-4ab4-8fd0-78193bc57938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b15173-1038-4216-be87-a37e68895c86', 'volume_name': 'volume-04b15173-1038-4216-be87-a37e68895c86', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f1409-ceee-4e9c-9292-855c769af36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:47 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8f1409-ceee-4e9c-9292-855c769af36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6630e905-b42e-471c-b9f4-7097938fbefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Volume 04b15173-1038-4216-be87-a37e68895c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b15173-1038-4216-be87-a37e68895c86', 'volume_size': 1} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296317532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b15173-1038-4216-be87-a37e68895c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:48Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Creating volume 04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:48 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:48 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 1073741824 Aug 05 15:54:48 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Flow 'volume_create_manager' (128afdba-e72d-40ee-a52b-d76559045ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beeac8d-d2e3-43e2-84c3-33efd58129d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beeac8d-d2e3-43e2-84c3-33efd58129d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230125064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3323e03-ab91-47bf-bc5b-e9909e26a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8f61ff30ab4b36b1d76b031563533d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:48Z,use_quota=True,user_id='adc68b2a1bb24ea99e5c7de4d8a9c6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f10f5a0-e4ea-4ac2-8326-a175c1dccc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f10f5a0-e4ea-4ac2-8326-a175c1dccc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ed6cf0-47c3-4f68-a594-ef0f1ea0e2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21ed6cf0-47c3-4f68-a594-ef0f1ea0e2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3323e03-ab91-47bf-bc5b-e9909e26a317', 'volume_name': 'volume-f3323e03-ab91-47bf-bc5b-e9909e26a317', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de273b69-61c3-48f3-8665-0035d973c2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de273b69-61c3-48f3-8665-0035d973c2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c98a64-1d07-483f-bb08-dc2dec748196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Volume f3323e03-ab91-47bf-bc5b-e9909e26a317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3323e03-ab91-47bf-bc5b-e9909e26a317', 'volume_size': 1} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:48 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 1073741824" returned: 0 in 0.446s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:48 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 Aug 05 15:54:48 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:48 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86" returned: 0 in 0.255s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1230125064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3323e03-ab91-47bf-bc5b-e9909e26a317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8f61ff30ab4b36b1d76b031563533d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:48Z,use_quota=True,user_id='adc68b2a1bb24ea99e5c7de4d8a9c6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Creating volume f3323e03-ab91-47bf-bc5b-e9909e26a317 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:48 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:48 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 1073741824 Aug 05 15:54:48 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6630e905-b42e-471c-b9f4-7097938fbefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b15173-1038-4216-be87-a37e68895c86', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101e8260-c401-4c7f-b7ac-968cda703159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:48 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Volume volume-04b15173-1038-4216-be87-a37e68895c86 (04b15173-1038-4216-be87-a37e68895c86): created successfully Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101e8260-c401-4c7f-b7ac-968cda703159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:48 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (0a3f8042-da94-48af-bd34-f6f2419eed7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-280f7d8e-8cfb-4609-a0fe-8afb6e30c750 tempest-ProjectReaderTests-1407980028 None] Created volume successfully. Aug 05 15:54:49 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 1073741824" returned: 0 in 0.441s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:49 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 Aug 05 15:54:49 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:49 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317" returned: 0 in 0.253s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c98a64-1d07-483f-bb08-dc2dec748196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3323e03-ab91-47bf-bc5b-e9909e26a317', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93658761-b140-4d9e-851d-721b5eb26ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Volume volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 (f3323e03-ab91-47bf-bc5b-e9909e26a317): created successfully Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93658761-b140-4d9e-851d-721b5eb26ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Flow 'volume_create_manager' (128afdba-e72d-40ee-a52b-d76559045ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:49 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-7433e8ad-27d3-4628-9679-4fde980f0a62 tempest-ProjectReaderTests-1172248058 None] Created volume successfully. Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (b35b591a-4b87-4ad0-ac97-799c55e37bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b84954c-2f4f-4c42-87a7-5dc79213461a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b84954c-2f4f-4c42-87a7-5dc79213461a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824184683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a37a2-8f15-4e91-a4fa-88b52b036c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:50Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38230cf3-4601-4449-9b2e-759547cd3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38230cf3-4601-4449-9b2e-759547cd3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99524779-2205-4822-9c84-2b3ad6138b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99524779-2205-4822-9c84-2b3ad6138b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '900a37a2-8f15-4e91-a4fa-88b52b036c06', 'volume_name': 'volume-900a37a2-8f15-4e91-a4fa-88b52b036c06', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1139b8-6897-43db-82ad-e108d82fc4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1139b8-6897-43db-82ad-e108d82fc4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a94350-2712-4258-b327-2e15ae68691a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:49 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Volume 900a37a2-8f15-4e91-a4fa-88b52b036c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-900a37a2-8f15-4e91-a4fa-88b52b036c06', 'volume_size': 1} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824184683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=900a37a2-8f15-4e91-a4fa-88b52b036c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:50Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Creating volume 900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:49 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:49 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:49 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 1073741824 Aug 05 15:54:49 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:50 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 1073741824" returned: 0 in 0.436s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 Aug 05 15:54:50 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06" returned: 0 in 0.260s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.376s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a94350-2712-4258-b327-2e15ae68691a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-900a37a2-8f15-4e91-a4fa-88b52b036c06', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97b5140-db15-4467-8221-89d2b19f0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "cinder-f3323e03-ab91-47bf-bc5b-e9909e26a317-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Creating offline snapshot bd26f636-6e78-4897-8908-f670d65b7845 of volume 04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Volume volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 (900a37a2-8f15-4e91-a4fa-88b52b036c06): created successfully Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97b5140-db15-4467-8221-89d2b19f0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (b35b591a-4b87-4ad0-ac97-799c55e37bf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9244d61-1090-46fb-b230-d9b412f0f830]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Lock "cinder-f3323e03-ab91-47bf-bc5b-e9909e26a317-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6ab8a5d7-b2ff-4ca9-b503-a34ed9d6141a tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "cinder-quobyte-f3323e03-ab91-47bf-bc5b-e9909e26a317" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Lock "cinder-quobyte-f3323e03-ab91-47bf-bc5b-e9909e26a317" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a16454-3b4c-4712-9939-e897dd0f4226]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:50 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 Aug 05 15:54:50 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 Aug 05 15:54:50 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:50 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86" returned: 0 in 0.443s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:51 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 1G Aug 05 15:54:51 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317" returned: 0 in 0.409s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317 Aug 05 15:54:51 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3323e03-ab91-47bf-bc5b-e9909e26a317" returned: 0 in 0.243s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Lock "cinder-quobyte-f3323e03-ab91-47bf-bc5b-e9909e26a317" released by "delete_volume" :: held 0.692s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Created reservations ['d9d7a36f-7802-4b68-b617-0e10905ba985', 'dc3a4c33-33fd-425a-a9f9-61eb5c3d342c', '0bb3dcc8-4034-4474-8cf8-8f91095109b6', '832b399d-45b3-4f18-b930-a8bab50e3b64'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:51 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 1G" returned: 0 in 0.400s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b15173-1038-4216-be87-a37e68895c86 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b15173-1038-4216-be87-a37e68895c86 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 Aug 05 15:54:51 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:51 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04b15173-1038-4216-be87-a37e68895c86 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845" returned: 0 in 0.305s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 is being set with open permissions: ugo+rw Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.260s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Deleted volume successfully. Aug 05 15:54:51 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 Aug 05 15:54:51 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-883287c2-9d97-4eb7-97ab-e6c8ccdb58d2 tempest-ProjectReaderTests-1172248058 None] Lock "cinder-f3323e03-ab91-47bf-bc5b-e9909e26a317-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:51 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845" returned: 0 in 0.262s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info Aug 05 15:54:52 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Flow 'volume_create_manager' (61e46707-1929-4386-8060-0af4c05282ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9971b303-94c9-429a-8d12-a3ad7b12f938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9971b303-94c9-429a-8d12-a3ad7b12f938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608397909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1861be37-8f80-45d4-9c90-459c37dc1bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8f61ff30ab4b36b1d76b031563533d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:52Z,use_quota=True,user_id='adc68b2a1bb24ea99e5c7de4d8a9c6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3525d4f2-01bd-40f7-a796-a5e470ddd4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3525d4f2-01bd-40f7-a796-a5e470ddd4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e83a1b-9246-4b5f-8b24-f6e861005489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e83a1b-9246-4b5f-8b24-f6e861005489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1861be37-8f80-45d4-9c90-459c37dc1bb1', 'volume_name': 'volume-1861be37-8f80-45d4-9c90-459c37dc1bb1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e185ee-d2a1-47ce-b14b-a9a1d4a3bfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70e185ee-d2a1-47ce-b14b-a9a1d4a3bfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6bbfb2-a5aa-4fcf-83fe-ec8b5e61ade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:52 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Volume 1861be37-8f80-45d4-9c90-459c37dc1bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1861be37-8f80-45d4-9c90-459c37dc1bb1', 'volume_size': 1} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:52 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info" returned: 0 in 0.269s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:52 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info is being set with open permissions: ugo+rw Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info Aug 05 15:54:52 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:52 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.info" returned: 0 in 0.282s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.089s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.541s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot 91875b9b-cadd-4b2e-929a-ad8bf74bbbaa of volume 900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:54:52 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-395446ca-678a-4563-876d-bf9055ae0fc3 tempest-ProjectReaderTests-1407980028 None] Create snapshot completed successfully Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e6ba8-0fa9-4680-b226-51546e4e8b10]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 Aug 05 15:54:52 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:52 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06" returned: 0 in 0.341s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:52 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa 1G Aug 05 15:54:52 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-bd26f636-6e78-4897-8908-f670d65b7845-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-bd26f636-6e78-4897-8908-f670d65b7845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-04b15173-1038-4216-be87-a37e68895c86" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-04b15173-1038-4216-be87-a37e68895c86" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-bd26f636-6e78-4897-8908-f670d65b7845" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-bd26f636-6e78-4897-8908-f670d65b7845" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Deleting offline snapshot bd26f636-6e78-4897-8908-f670d65b7845 of volume 04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] snapshot_file for this snap is: volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:53 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa 1G" returned: 0 in 0.423s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6d39e1-6e46-40d2-9532-c6e0b74252ef]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa Aug 05 15:54:53 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 Aug 05 15:54:53 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" returned: 0 in 0.278s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa is being set with open permissions: ugo+rw Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa Aug 05 15:54:53 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845" returned: 0 in 0.370s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04b15173-1038-4216-be87-a37e68895c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[91572fa4-ff27-4a3a-bc9f-cc9b177c78ba]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:53 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 Aug 05 15:54:53 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:53 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info Aug 05 15:54:53 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86" returned: 0 in 0.404s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info" returned: 0 in 0.275s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info is being set with open permissions: ugo+rw Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 Aug 05 15:54:54 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info Aug 05 15:54:54 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.info" returned: 0 in 0.242s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.237s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608397909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1861be37-8f80-45d4-9c90-459c37dc1bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8f61ff30ab4b36b1d76b031563533d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:52Z,use_quota=True,user_id='adc68b2a1bb24ea99e5c7de4d8a9c6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Creating volume 1861be37-8f80-45d4-9c90-459c37dc1bb1 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:54 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 1073741824 Aug 05 15:54:54 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-cf5dbdbd-cf94-4f55-85d2-d6424e90fff3 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:54:54 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845 Aug 05 15:54:54 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86.bd26f636-6e78-4897-8908-f670d65b7845" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-bd26f636-6e78-4897-8908-f670d65b7845" released by "_delete_snapshot" :: held 1.462s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-04b15173-1038-4216-be87-a37e68895c86" released by "delete_snapshot" :: held 1.482s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Created reservations ['0eaba681-cf8c-4761-9309-7967cab7c274', '9591e814-a948-483b-8892-9e0bf2a4ab0c', '50fa6d5f-55c9-48f5-89c6-a4692f8b893b', 'df2db915-d4d9-4af0-9cd6-83c6f75f5592'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:54 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 1073741824" returned: 0 in 0.411s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Delete snapshot completed successfully. Aug 05 15:54:54 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 Aug 05 15:54:54 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5e792c33-2bb2-4988-a508-3da87db5b008 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-bd26f636-6e78-4897-8908-f670d65b7845-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:55 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1" returned: 0 in 0.247s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e6bbfb2-a5aa-4fcf-83fe-ec8b5e61ade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1861be37-8f80-45d4-9c90-459c37dc1bb1', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d0a998-9578-41aa-a0a3-348aae04393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-91875b9b-cadd-4b2e-929a-ad8bf74bbbaa-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:55 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Volume volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 (1861be37-8f80-45d4-9c90-459c37dc1bb1): created successfully Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d0a998-9578-41aa-a0a3-348aae04393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Flow 'volume_create_manager' (61e46707-1929-4386-8060-0af4c05282ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Lock "cinder-91875b9b-cadd-4b2e-929a-ad8bf74bbbaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-900a37a2-8f15-4e91-a4fa-88b52b036c06" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:55 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-aa67413d-74ee-4405-a08f-9618f8bb5b16 tempest-ProjectReaderTests-1172248058 None] Created volume successfully. Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-900a37a2-8f15-4e91-a4fa-88b52b036c06" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot 91875b9b-cadd-4b2e-929a-ad8bf74bbbaa of volume 900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c09a37-a491-45bf-8be5-04b2a9ed2110]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:55 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa Aug 05 15:54:55 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-04b15173-1038-4216-be87-a37e68895c86-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-04b15173-1038-4216-be87-a37e68895c86-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-04b15173-1038-4216-be87-a37e68895c86" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-04b15173-1038-4216-be87-a37e68895c86" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ff424-4a3e-46b9-b478-fbfed564056e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:55 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" returned: 0 in 0.355s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-900a37a2-8f15-4e91-a4fa-88b52b036c06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e104445a-5c78-4a34-98a8-d6c0f0e59848]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:55 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 Aug 05 15:54:55 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:55 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 Aug 05 15:54:55 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:55 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86" returned: 0 in 0.362s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:55 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86 Aug 05 15:54:55 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:56 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06" returned: 0 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:56 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa Aug 05 15:54:56 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:56 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-04b15173-1038-4216-be87-a37e68895c86" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-04b15173-1038-4216-be87-a37e68895c86" released by "delete_volume" :: held 0.676s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Created reservations ['fd3b8e08-d96f-4c55-bb38-ed14baa5d38f', '26572b79-4086-44a3-afcd-73559c73c2d7', 'd9dcee0b-288d-4e79-90a2-7ef2ebbc729d', 'd6423f60-f154-4f0b-92f8-ec5dd1d4e3f5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Acquiring lock "cinder-1861be37-8f80-45d4-9c90-459c37dc1bb1-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:56 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:56 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Lock "cinder-1861be37-8f80-45d4-9c90-459c37dc1bb1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Acquiring lock "cinder-quobyte-1861be37-8f80-45d4-9c90-459c37dc1bb1" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Lock "cinder-quobyte-1861be37-8f80-45d4-9c90-459c37dc1bb1" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:56 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" returned: 0 in 0.437s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c7997-88db-43d7-92dc-3e355e193356]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:56 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa Aug 05 15:54:56 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:56 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 Aug 05 15:54:56 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:56 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Deleted volume successfully. Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-23fa7b3f-c40c-48ce-b8da-64737dc60778 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-04b15173-1038-4216-be87-a37e68895c86-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:56 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06.91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" returned: 0 in 0.278s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-91875b9b-cadd-4b2e-929a-ad8bf74bbbaa" released by "_delete_snapshot" :: held 1.549s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-900a37a2-8f15-4e91-a4fa-88b52b036c06" released by "delete_snapshot" :: held 1.578s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:56 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1" returned: 0 in 0.393s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:56 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1 Aug 05 15:54:56 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:56 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Created reservations ['72fe2ec3-a884-426a-b293-6a60bd7abc7b', 'bc05b373-2d71-4110-be91-eae9a5a0b2cf', 'ce16f71b-0014-4cee-a650-dbb0eb0ab45f', '78f74225-05ee-414a-bc56-c9f045e6cc06'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:56 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-b3f81854-ecf5-49a9-be9a-5ae21a3e5b4e tempest-ProjectMemberTests-514781381 None] Lock "cinder-91875b9b-cadd-4b2e-929a-ad8bf74bbbaa-delete_snapshot" released by "delete_snapshot" :: held 1.799s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (57493d2b-dd83-4d95-a735-ed4bfa306c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:57 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d56c6cd-7d0e-4bbc-987a-d4c9f122919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-1861be37-8f80-45d4-9c90-459c37dc1bb1" returned: 0 in 0.290s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Lock "cinder-quobyte-1861be37-8f80-45d4-9c90-459c37dc1bb1" released by "delete_volume" :: held 0.734s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d56c6cd-7d0e-4bbc-987a-d4c9f122919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552137062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:57Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4fa7df-cb93-4d9e-a1bc-562fe3a1bdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4fa7df-cb93-4d9e-a1bc-562fe3a1bdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691779c4-0479-4cb6-af31-be168fd30694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691779c4-0479-4cb6-af31-be168fd30694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7', 'volume_name': 'volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eebc943-8776-48d1-9291-1655030823e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eebc943-8776-48d1-9291-1655030823e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c010b38-baba-46fe-9dd4-651fd70d8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:57 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Volume 9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7', 'volume_size': 1} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1552137062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:57Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Creating volume 9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:57 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 1073741824 Aug 05 15:54:57 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Created reservations ['f406d780-ed8f-49b5-87af-4709a88bd08a', '6ae55de8-4684-4907-9548-eebfee17cd68', 'f2c90aa1-b053-41bc-b510-ebb99e1e5244', '04860d82-df14-4d0a-9509-6c65dc8914e1'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-900a37a2-8f15-4e91-a4fa-88b52b036c06-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:57 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Lock "cinder-900a37a2-8f15-4e91-a4fa-88b52b036c06-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-900a37a2-8f15-4e91-a4fa-88b52b036c06" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-900a37a2-8f15-4e91-a4fa-88b52b036c06" acquired by "delete_volume" :: waited 0.024s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc0dc5b-9417-4fc3-8db8-35f9b3a5c538]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 Aug 05 15:54:57 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:57 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.324s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:57 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Deleted volume successfully. Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-abf10426-a0e8-4c6a-b16d-43343c084e0c tempest-ProjectReaderTests-1172248058 None] Lock "cinder-1861be37-8f80-45d4-9c90-459c37dc1bb1-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:57 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 1073741824" returned: 0 in 0.542s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 Aug 05 15:54:57 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:57 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06" returned: 0 in 0.438s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:57 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:57 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06 Aug 05 15:54:57 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:58 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" returned: 0 in 0.299s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c010b38-baba-46fe-9dd4-651fd70d8600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2372145-a7e4-417c-8d82-db9c8cc89045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:58 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Volume volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 (9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7): created successfully Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2372145-a7e4-417c-8d82-db9c8cc89045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (57493d2b-dd83-4d95-a735-ed4bfa306c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-8dca74d4-9376-4db0-884f-8dd19e31ef18 tempest-ProjectReaderTests-1407980028 None] Created volume successfully. Aug 05 15:54:58 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-900a37a2-8f15-4e91-a4fa-88b52b036c06" returned: 0 in 0.298s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-900a37a2-8f15-4e91-a4fa-88b52b036c06" released by "delete_volume" :: held 0.805s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Created reservations ['14642d2e-b06b-4b48-bb3d-b15e771f9818', 'bc29d293-27de-4853-8097-a7a5ade60e9a', 'fbc5185e-7760-4420-8362-bf5b31185bf4', '19c6e307-d632-49b9-a34d-fa5f2cb187a5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:58 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:54:58 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:58 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:54:58 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:54:58 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-e85b9352-8763-43eb-b304-cc0259a7109c tempest-ProjectMemberTests-514781381 None] Lock "cinder-900a37a2-8f15-4e91-a4fa-88b52b036c06-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (643f19df-c489-40e2-bfc9-17e9de3e0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c669a212-ba47-488d-a3db-ac6c56049e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c669a212-ba47-488d-a3db-ac6c56049e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224504204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b0fee8-ca5e-4270-91c5-405624152901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:59Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7358c17-ad40-4b4d-96b2-d4d834d18e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7358c17-ad40-4b4d-96b2-d4d834d18e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa0bfac-f921-4abb-aa2a-b63b8cf1b8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daa0bfac-f921-4abb-aa2a-b63b8cf1b8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b0fee8-ca5e-4270-91c5-405624152901', 'volume_name': 'volume-12b0fee8-ca5e-4270-91c5-405624152901', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7f09df-21f2-4491-9ff3-49c76603e775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce7f09df-21f2-4491-9ff3-49c76603e775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7576260-43aa-4a8c-88bc-f8bf519927fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:54:59 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Volume 12b0fee8-ca5e-4270-91c5-405624152901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b0fee8-ca5e-4270-91c5-405624152901', 'volume_size': 1} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224504204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b0fee8-ca5e-4270-91c5-405624152901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:54:59Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Creating volume 12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:54:59 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:59 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 1073741824 Aug 05 15:54:59 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:54:59 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 1073741824" returned: 0 in 0.493s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:54:59 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 Aug 05 15:54:59 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:54:59 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901" returned: 0 in 0.245s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:54:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7576260-43aa-4a8c-88bc-f8bf519927fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b0fee8-ca5e-4270-91c5-405624152901', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d689878a-ddf7-4a2a-bd86-b482c8ce14ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Creating offline snapshot e0798123-f99f-4b63-9c2d-7252bfe5072e of volume 9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:00 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Volume volume-12b0fee8-ca5e-4270-91c5-405624152901 (12b0fee8-ca5e-4270-91c5-405624152901): created successfully Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d689878a-ddf7-4a2a-bd86-b482c8ce14ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (643f19df-c489-40e2-bfc9-17e9de3e0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1183e49-63e5-453b-875d-a64919ada5b0]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:00 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-84703ae2-ce9d-4730-a079-f116dfce7fb7 tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:00 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 Aug 05 15:55:00 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:00 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" returned: 0 in 0.368s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:00 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e 1G Aug 05 15:55:00 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:00 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e 1G" returned: 0 in 0.444s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:00 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e Aug 05 15:55:00 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:01 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e" returned: 0 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:01 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e is being set with open permissions: ugo+rw Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:01 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e Aug 05 15:55:01 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:01 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:01 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info Aug 05 15:55:01 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:01 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:01 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info is being set with open permissions: ugo+rw Aug 05 15:55:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:01 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info Aug 05 15:55:01 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:02 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.info" returned: 0 in 0.262s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.104s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.714s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot 65fc9684-0df4-4bb8-8fb8-d9294ed49c40 of volume 12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:02 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f720e591-db40-4452-a259-1f689f0922a7 tempest-ProjectReaderTests-1407980028 None] Create snapshot completed successfully Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee58ec7-7162-403a-a20c-13b721ac261e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:02 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 Aug 05 15:55:02 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:02 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901" returned: 0 in 0.412s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:02 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 1G Aug 05 15:55:02 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-e0798123-f99f-4b63-9c2d-7252bfe5072e-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-e0798123-f99f-4b63-9c2d-7252bfe5072e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-e0798123-f99f-4b63-9c2d-7252bfe5072e" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-e0798123-f99f-4b63-9c2d-7252bfe5072e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Deleting offline snapshot e0798123-f99f-4b63-9c2d-7252bfe5072e of volume 9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] snapshot_file for this snap is: volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[50edb94d-4253-430b-b5c3-46756588dc21]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:02 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e Aug 05 15:55:02 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 1G" returned: 0 in 0.470s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b0fee8-ca5e-4270-91c5-405624152901 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b0fee8-ca5e-4270-91c5-405624152901 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 Aug 05 15:55:03 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e" returned: 0 in 0.395s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d53b8fe-4c02-45ca-9210-d2c77dbc88e9]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 Aug 05 15:55:03 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12b0fee8-ca5e-4270-91c5-405624152901 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40" returned: 0 in 0.303s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:03 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 is being set with open permissions: ugo+rw Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 Aug 05 15:55:03 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40" returned: 0 in 0.247s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:03 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e Aug 05 15:55:03 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info Aug 05 15:55:03 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info" returned: 0 in 0.263s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:03 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info is being set with open permissions: ugo+rw Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:03 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info Aug 05 15:55:03 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:03 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e" returned: 0 in 0.395s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:04 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e Aug 05 15:55:04 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:04 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.info" returned: 0 in 0.279s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-67052aa0-6d0f-4ad4-934b-37c113a3fec8 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:55:04 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7.e0798123-f99f-4b63-9c2d-7252bfe5072e" returned: 0 in 0.296s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-e0798123-f99f-4b63-9c2d-7252bfe5072e" released by "_delete_snapshot" :: held 1.595s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" released by "delete_snapshot" :: held 1.632s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Created reservations ['6c048499-9efa-4c3c-be30-f7d812677aec', 'e9b8b426-93a0-4bf3-9e4e-61d2af1e0c8d', '667aad0f-4c5f-41d8-bfea-42ae5ec9a585', '597ce4b6-76c4-44f8-944d-52f4ab9beeb3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Delete snapshot completed successfully. Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-5ac0ebfc-10ee-4cea-a006-7cb944b56109 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-e0798123-f99f-4b63-9c2d-7252bfe5072e-delete_snapshot" released by "delete_snapshot" :: held 1.869s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-65fc9684-0df4-4bb8-8fb8-d9294ed49c40-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Lock "cinder-65fc9684-0df4-4bb8-8fb8-d9294ed49c40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-12b0fee8-ca5e-4270-91c5-405624152901" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-12b0fee8-ca5e-4270-91c5-405624152901" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-65fc9684-0df4-4bb8-8fb8-d9294ed49c40" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-65fc9684-0df4-4bb8-8fb8-d9294ed49c40" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot 65fc9684-0df4-4bb8-8fb8-d9294ed49c40 of volume 12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaa58ca-30e4-4549-9ba2-66666de51283]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:04 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 Aug 05 15:55:04 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Lock "cinder-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1544ba41-8072-4d4d-b871-6c57568b3487]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 Aug 05 15:55:05 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40" returned: 0 in 0.427s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12b0fee8-ca5e-4270-91c5-405624152901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dc0994-54c4-48a6-a2d2-656b5870e9c1]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 Aug 05 15:55:05 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" returned: 0 in 0.391s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7 Aug 05 15:55:05 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901" returned: 0 in 0.379s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 Aug 05 15:55:05 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7" released by "delete_volume" :: held 0.718s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Created reservations ['76fa0871-ab11-4e60-bacf-ef14b9639479', '87f65797-fc38-4f1b-b5d6-de5cf751bc25', 'd7027144-e0cc-4840-bcf6-c324838e2710', '1bb27383-9846-453a-a91f-ea7cfaf673b6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:05 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40" returned: 0 in 0.358s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:05 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40 Aug 05 15:55:05 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:05 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.243s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:05 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:05 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Deleted volume successfully. Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-aa9c3080-90d9-4367-b604-119b5ed1678e tempest-ProjectReaderTests-1407980028 None] Lock "cinder-9fc7edf1-00b1-4b9e-b995-f23dc70c3fd7-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:06 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901.65fc9684-0df4-4bb8-8fb8-d9294ed49c40" returned: 0 in 0.269s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-65fc9684-0df4-4bb8-8fb8-d9294ed49c40" released by "_delete_snapshot" :: held 1.539s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-12b0fee8-ca5e-4270-91c5-405624152901" released by "delete_snapshot" :: held 1.566s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Created reservations ['d069afbd-f20a-4b1f-9c3a-5b1607501e8b', 'e5515d5d-62b1-4d88-8844-e9f3dcdf29ef', '5f85e446-4a0e-436f-94ba-6cc1370f4dd8', 'ed947162-d245-46b4-85d0-f880bcb6118f'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:06 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-58e95257-d821-488a-a50e-5c21555f8e47 tempest-ProjectMemberTests-514781381 None] Lock "cinder-65fc9684-0df4-4bb8-8fb8-d9294ed49c40-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (7a385587-1740-4064-b6d1-f9477c642808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb77deb4-97be-4442-bbdf-9ef43f46033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb77deb4-97be-4442-bbdf-9ef43f46033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302912435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489dfe60-99eb-4cd1-a248-18c3b0e1499f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:06Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064db7d2-8847-4186-9fd6-2584efb4351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (064db7d2-8847-4186-9fd6-2584efb4351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd19d4a-6a06-4418-be8d-eec76b07cb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd19d4a-6a06-4418-be8d-eec76b07cb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489dfe60-99eb-4cd1-a248-18c3b0e1499f', 'volume_name': 'volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79555d94-6b70-4d24-9a9d-7e8b2e79582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79555d94-6b70-4d24-9a9d-7e8b2e79582f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431548f3-0ee4-4b07-bc81-033b473c8b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Volume 489dfe60-99eb-4cd1-a248-18c3b0e1499f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f', 'volume_size': 1} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-302912435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489dfe60-99eb-4cd1-a248-18c3b0e1499f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:06Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Creating volume 489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:06 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:06 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f 1073741824 Aug 05 15:55:06 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-12b0fee8-ca5e-4270-91c5-405624152901-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Lock "cinder-12b0fee8-ca5e-4270-91c5-405624152901-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-12b0fee8-ca5e-4270-91c5-405624152901" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-12b0fee8-ca5e-4270-91c5-405624152901" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc3f123-d7c6-49ef-9412-a7dba65421ff]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:06 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f 1073741824" returned: 0 in 0.443s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 Aug 05 15:55:07 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f Aug 05 15:55:07 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901" returned: 0 in 0.361s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:07 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901 Aug 05 15:55:07 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431548f3-0ee4-4b07-bc81-033b473c8b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198602fc-4742-464d-b6e7-2d64216b54cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Volume volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f (489dfe60-99eb-4cd1-a248-18c3b0e1499f): created successfully Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (198602fc-4742-464d-b6e7-2d64216b54cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (7a385587-1740-4064-b6d1-f9477c642808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-5dbd0844-5e64-4814-8b67-e04448ca7557 tempest-ProjectReaderTests-1407980028 None] Created volume successfully. Aug 05 15:55:07 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-12b0fee8-ca5e-4270-91c5-405624152901" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-12b0fee8-ca5e-4270-91c5-405624152901" released by "delete_volume" :: held 0.675s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Created reservations ['211af274-a36d-4b11-b1eb-5329edfd94ff', '4d13eeab-53a6-4ca2-8f1f-9f8ece8fa393', 'cbb4dc3f-4b61-41a1-9e63-eeb9de7c6304', '93a58295-3555-45b6-997e-1393e437bc53'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Creating offline snapshot eb66dd01-1b47-4663-931e-77b4787c46bd of volume 489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e8fafe-c1d2-4d10-a614-85581de5b7d6]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:07 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:07 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f Aug 05 15:55:07 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:07 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.253s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:55:07 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-fd1d37e5-9b4d-48bf-8fb5-5f05115026dc tempest-ProjectMemberTests-514781381 None] Lock "cinder-12b0fee8-ca5e-4270-91c5-405624152901-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:08 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f" returned: 0 in 0.378s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd 1G Aug 05 15:55:08 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (c805ca0b-0ab1-454d-bd2d-72668850e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc57fa7-f450-4c30-9971-5c5c419d81a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc57fa7-f450-4c30-9971-5c5c419d81a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925746988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4b1fc1-c963-4e0c-998c-1a06e6589512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:08Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:08 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d44e70d-7cf8-43bd-ba2f-b1e661b67afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d44e70d-7cf8-43bd-ba2f-b1e661b67afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd3724-91db-40f3-b951-ce5ff9f047ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cabd3724-91db-40f3-b951-ce5ff9f047ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f4b1fc1-c963-4e0c-998c-1a06e6589512', 'volume_name': 'volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9828ab28-e591-48fa-8737-097bf3b521f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9828ab28-e591-48fa-8737-097bf3b521f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1db2332-b5b3-46c5-a1ab-24681cebbdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:08 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Volume 4f4b1fc1-c963-4e0c-998c-1a06e6589512: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512', 'volume_size': 1} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd 1G" returned: 0 in 0.457s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd Aug 05 15:55:08 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:08 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:08 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd is being set with open permissions: ugo+rw Aug 05 15:55:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:08 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd Aug 05 15:55:08 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd" returned: 0 in 0.234s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:09 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info Aug 05 15:55:09 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info" returned: 0 in 0.233s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info is being set with open permissions: ugo+rw Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:09 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info Aug 05 15:55:09 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.info" returned: 0 in 0.240s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-925746988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f4b1fc1-c963-4e0c-998c-1a06e6589512,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:08Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Creating volume 4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:09 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:09 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 1073741824 Aug 05 15:55:09 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:09 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-39114c25-1af2-427a-bfee-03449a422fa2 tempest-ProjectReaderTests-1407980028 None] Create snapshot completed successfully Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-eb66dd01-1b47-4663-931e-77b4787c46bd-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Lock "cinder-eb66dd01-1b47-4663-931e-77b4787c46bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-489dfe60-99eb-4cd1-a248-18c3b0e1499f" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-489dfe60-99eb-4cd1-a248-18c3b0e1499f" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-eb66dd01-1b47-4663-931e-77b4787c46bd" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-eb66dd01-1b47-4663-931e-77b4787c46bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Deleting offline snapshot eb66dd01-1b47-4663-931e-77b4787c46bd of volume 489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] snapshot_file for this snap is: volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[076c1086-b33b-4f8b-b74b-0efad1bb9caf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:09 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd Aug 05 15:55:09 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:10 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 1073741824" returned: 0 in 0.513s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:10 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 Aug 05 15:55:10 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:10 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:10 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:10 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd" returned: 0 in 0.415s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[634f51ca-9a44-4097-aaff-51299c33f1cb]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:10 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512" returned: 0 in 0.259s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1db2332-b5b3-46c5-a1ab-24681cebbdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aa4840-fcec-4b7b-b034-ed2a926c7012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:10 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Volume volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 (4f4b1fc1-c963-4e0c-998c-1a06e6589512): created successfully Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3aa4840-fcec-4b7b-b034-ed2a926c7012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (c805ca0b-0ab1-454d-bd2d-72668850e421) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:10 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-bf4130bc-be18-41c4-9996-f20d113ce0f6 tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:10 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.312s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:10 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f Aug 05 15:55:10 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:55:10 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f" returned: 0 in 0.417s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:10 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd Aug 05 15:55:10 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:11 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd" returned: 0 in 0.317s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:11 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd Aug 05 15:55:11 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:11 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f.eb66dd01-1b47-4663-931e-77b4787c46bd" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-eb66dd01-1b47-4663-931e-77b4787c46bd" released by "_delete_snapshot" :: held 1.507s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-489dfe60-99eb-4cd1-a248-18c3b0e1499f" released by "delete_snapshot" :: held 1.531s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Created reservations ['8cd91e32-4989-436c-a085-ce3bba352f67', 'f79eb5cd-e8d2-4634-8fd6-4deddcb37bc6', 'a2f5a43a-cfbf-4e2c-ab22-412807869cf4', 'a7d2b634-2326-488f-9f5d-6af5cc4826a6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Delete snapshot completed successfully. Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-9e4b99ff-c80e-46da-ba32-afc8f9e7890d tempest-ProjectReaderTests-1407980028 None] Lock "cinder-eb66dd01-1b47-4663-931e-77b4787c46bd-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot 814f52bb-ef02-49d4-b81f-d975d7c0cbc3 of volume 4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1bca8-fe04-43eb-9dfa-ddc2ea87157c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:11 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 Aug 05 15:55:11 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-489dfe60-99eb-4cd1-a248-18c3b0e1499f-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-489dfe60-99eb-4cd1-a248-18c3b0e1499f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-489dfe60-99eb-4cd1-a248-18c3b0e1499f" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-489dfe60-99eb-4cd1-a248-18c3b0e1499f" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98b3071-e01a-4493-bb2b-873d73ff23f3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512" returned: 0 in 0.358s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f Aug 05 15:55:12 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 1G Aug 05 15:55:12 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f" returned: 0 in 0.361s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f Aug 05 15:55:12 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 1G" returned: 0 in 0.393s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 Aug 05 15:55:12 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-489dfe60-99eb-4cd1-a248-18c3b0e1499f" returned: 0 in 0.246s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-489dfe60-99eb-4cd1-a248-18c3b0e1499f" released by "delete_volume" :: held 0.670s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Created reservations ['639fe2bf-8489-4079-9360-c81501f8aee3', 'b794b90b-6fa3-437d-b9b2-c4eca85e4e5d', '9a9b1c4d-caaa-491c-a7df-528409f512d1', '6d12e84d-31d4-4cef-a366-7d3eebe38fc5'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3" returned: 0 in 0.289s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:12 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 is being set with open permissions: ugo+rw Aug 05 15:55:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:12 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:12 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:12 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 Aug 05 15:55:12 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:13 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.274s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:13 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3" returned: 0 in 0.261s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Deleted volume successfully. Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2df1d9b7-7c9e-4be1-8b74-2a19f9e218e1 tempest-ProjectReaderTests-1407980028 None] Lock "cinder-489dfe60-99eb-4cd1-a248-18c3b0e1499f-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:13 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info Aug 05 15:55:13 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:13 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:13 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info is being set with open permissions: ugo+rw Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:13 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info Aug 05 15:55:13 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (8c4c3cd2-0411-4f2b-9288-d34158247508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47de041-fcad-48cd-8a44-285f2915eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47de041-fcad-48cd-8a44-285f2915eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765525039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158dc8d1-8b99-43ad-9018-0bf1e2313e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:14Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3021ee-e684-4535-9ad0-e13d809e8405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3021ee-e684-4535-9ad0-e13d809e8405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:13 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830cea2c-002e-43fd-bbaf-294c87d99bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830cea2c-002e-43fd-bbaf-294c87d99bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '158dc8d1-8b99-43ad-9018-0bf1e2313e64', 'volume_name': 'volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48fa860-c821-4cea-bcee-a0cc8967a264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a48fa860-c821-4cea-bcee-a0cc8967a264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e818b-fa02-4fd2-8b82-6b54f85d84ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:13 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Volume 158dc8d1-8b99-43ad-9018-0bf1e2313e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64', 'volume_size': 1} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.info" returned: 0 in 0.271s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765525039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=158dc8d1-8b99-43ad-9018-0bf1e2313e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a615304e6074e8bb39027a56080acb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:14Z,use_quota=True,user_id='1eb0c60ad7bd49dda87a0bc965d77d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Creating volume 158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:13 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:13 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 1073741824 Aug 05 15:55:13 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-c1e0a38a-2732-436a-8061-6afd3c7c0c04 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-814f52bb-ef02-49d4-b81f-d975d7c0cbc3-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Lock "cinder-814f52bb-ef02-49d4-b81f-d975d7c0cbc3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-4f4b1fc1-c963-4e0c-998c-1a06e6589512" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-4f4b1fc1-c963-4e0c-998c-1a06e6589512" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-814f52bb-ef02-49d4-b81f-d975d7c0cbc3" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-814f52bb-ef02-49d4-b81f-d975d7c0cbc3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot 814f52bb-ef02-49d4-b81f-d975d7c0cbc3 of volume 4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e88b44-00cc-4140-af7c-fc328fa33461]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 Aug 05 15:55:14 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:14 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 1073741824" returned: 0 in 0.477s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 Aug 05 15:55:14 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:14 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3" returned: 0 in 0.382s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a57ccd-7fd8-4574-896b-1325e112759f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e818b-fa02-4fd2-8b82-6b54f85d84ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f445b24-5b59-4c5f-a335-8c80f65dc772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:14 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 Aug 05 15:55:14 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:14 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Volume volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 (158dc8d1-8b99-43ad-9018-0bf1e2313e64): created successfully Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f445b24-5b59-4c5f-a335-8c80f65dc772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Flow 'volume_create_manager' (8c4c3cd2-0411-4f2b-9288-d34158247508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:14 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4fe9e750-a4a0-42ad-81b9-c809575b061a tempest-ProjectReaderTests-1407980028 None] Created volume successfully. Aug 05 15:55:14 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512" returned: 0 in 0.368s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:14 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:14 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 Aug 05 15:55:14 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:15 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3" returned: 0 in 0.327s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:15 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3 Aug 05 15:55:15 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:15 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512.814f52bb-ef02-49d4-b81f-d975d7c0cbc3" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-814f52bb-ef02-49d4-b81f-d975d7c0cbc3" released by "_delete_snapshot" :: held 1.412s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-4f4b1fc1-c963-4e0c-998c-1a06e6589512" released by "delete_snapshot" :: held 1.434s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Created reservations ['c6da3ace-d8a6-49a7-9db3-1fbb54eacef3', 'a1e87ef9-1fa1-4970-b758-8f14187f9c16', '73707be4-11dd-483b-828e-b3ff2ca82744', '9e752465-c523-4c50-8858-9d6da441d5a4'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:15 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-71be4679-f401-47de-8f79-c88997fa255d tempest-ProjectMemberTests-514781381 None] Lock "cinder-814f52bb-ef02-49d4-b81f-d975d7c0cbc3-delete_snapshot" released by "delete_snapshot" :: held 1.579s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Creating offline snapshot 83be0994-136e-4bd8-b63e-8beef33d5dc0 of volume 158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9da7a2-45ae-44ce-8cb0-23087f2fc723]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:15 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:15 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 Aug 05 15:55:15 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-4f4b1fc1-c963-4e0c-998c-1a06e6589512-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Lock "cinder-4f4b1fc1-c963-4e0c-998c-1a06e6589512-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-4f4b1fc1-c963-4e0c-998c-1a06e6589512" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-4f4b1fc1-c963-4e0c-998c-1a06e6589512" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79078a7-9013-4c8f-b87e-c50962e06143]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64" returned: 0 in 0.385s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 1G Aug 05 15:55:16 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:16 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 Aug 05 15:55:16 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:16 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512" returned: 0 in 0.364s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512 Aug 05 15:55:16 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:16 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 1G" returned: 0 in 0.429s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 Aug 05 15:55:16 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:16 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-4f4b1fc1-c963-4e0c-998c-1a06e6589512" returned: 0 in 0.282s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-4f4b1fc1-c963-4e0c-998c-1a06e6589512" released by "delete_volume" :: held 0.711s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Created reservations ['1510e35f-5f1e-4453-8b52-54bfe56027ed', '7bc02c12-9097-450d-8532-02fce54d259b', 'e84c74e6-ec46-4366-9223-8d638cee23be', '5d22a5e9-673f-430d-9e08-250145d98fc6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0" returned: 0 in 0.332s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:16 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 is being set with open permissions: ugo+rw Aug 05 15:55:16 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:16 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:16 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:17 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 Aug 05 15:55:17 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:17 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.261s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:55:17 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4e059045-fc3c-4635-b900-53d179edbca7 tempest-ProjectMemberTests-514781381 None] Lock "cinder-4f4b1fc1-c963-4e0c-998c-1a06e6589512-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:17 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info Aug 05 15:55:17 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:17 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info" returned: 0 in 0.249s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:17 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info is being set with open permissions: ugo+rw Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:17 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info Aug 05 15:55:17 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (fb35bcab-c91b-479f-9bd3-9f4147c10183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bac70ba-0d71-4a20-91d9-9a548214fbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bac70ba-0d71-4a20-91d9-9a548214fbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037606797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a06ae26-2c9c-43a2-9643-26a81b0f2527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:18Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd790a55-e5c9-4fe7-9dbd-0e25f64861b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:17 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd790a55-e5c9-4fe7-9dbd-0e25f64861b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a796091-bf88-4832-ac70-532505d4c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a796091-bf88-4832-ac70-532505d4c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a06ae26-2c9c-43a2-9643-26a81b0f2527', 'volume_name': 'volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa040b18-7631-4c90-9eb0-d80be37bba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa040b18-7631-4c90-9eb0-d80be37bba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e3bc60-7155-422d-afd1-f791610e25d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:17 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Volume 0a06ae26-2c9c-43a2-9643-26a81b0f2527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527', 'volume_size': 1} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.info" returned: 0 in 0.274s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1037606797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a06ae26-2c9c-43a2-9643-26a81b0f2527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:18Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Creating volume 0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:17 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:17 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:17 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 1073741824 Aug 05 15:55:17 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:17 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-ca2cedaf-7126-4d3f-bfb8-5079be7885f8 tempest-ProjectReaderTests-1407980028 None] Create snapshot completed successfully Aug 05 15:55:18 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 1073741824" returned: 0 in 0.407s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:18 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 Aug 05 15:55:18 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:18 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527" returned: 0 in 0.247s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e3bc60-7155-422d-afd1-f791610e25d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9144913-83de-422a-93de-cd6dec113225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:18 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Volume volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 (0a06ae26-2c9c-43a2-9643-26a81b0f2527): created successfully Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9144913-83de-422a-93de-cd6dec113225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (fb35bcab-c91b-479f-9bd3-9f4147c10183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:18 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2fe48338-12ea-451f-8e49-52baac89f9cf tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot ca07543e-9a2c-4df1-a61d-d3ce20b3e7be of volume 0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb91fa-4400-4ec2-86ed-410d87d6ca39]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:18 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-83be0994-136e-4bd8-b63e-8beef33d5dc0-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Lock "cinder-83be0994-136e-4bd8-b63e-8beef33d5dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-158dc8d1-8b99-43ad-9018-0bf1e2313e64" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-158dc8d1-8b99-43ad-9018-0bf1e2313e64" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-83be0994-136e-4bd8-b63e-8beef33d5dc0" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:19 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-83be0994-136e-4bd8-b63e-8beef33d5dc0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:19 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Deleting offline snapshot 83be0994-136e-4bd8-b63e-8beef33d5dc0 of volume 158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] snapshot_file for this snap is: volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee95ed-fa0b-42c3-870a-d6771ddc3c20]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 Aug 05 15:55:19 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527" returned: 0 in 0.401s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[109262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be 1G Aug 05 15:55:19 devstack sudo[109262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0" returned: 0 in 0.379s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2ebb51-8bca-4a7c-a0d9-a7b81cb9b0b5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 Aug 05 15:55:19 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack sudo[109262]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be 1G" returned: 0 in 0.478s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be Aug 05 15:55:19 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:19 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64" returned: 0 in 0.442s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:19 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:19 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 Aug 05 15:55:19 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" returned: 0 in 0.353s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be is being set with open permissions: ugo+rw Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:20 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be Aug 05 15:55:20 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0" returned: 0 in 0.349s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:20 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0 Aug 05 15:55:20 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" returned: 0 in 0.280s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:20 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info Aug 05 15:55:20 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64.83be0994-136e-4bd8-b63e-8beef33d5dc0" returned: 0 in 0.293s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-83be0994-136e-4bd8-b63e-8beef33d5dc0" released by "_delete_snapshot" :: held 1.576s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-158dc8d1-8b99-43ad-9018-0bf1e2313e64" released by "delete_snapshot" :: held 1.600s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Created reservations ['04d97e34-4f36-4d8f-afb8-7bc0b9ba15f8', '3cb18c8c-b57b-4505-bf41-c11de755c8e2', '53a99b96-9f04-452b-8f72-c5d54c022732', 'd8234c50-e178-447c-897a-62b8f4af86c0'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:20 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Delete snapshot completed successfully. Aug 05 15:55:20 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a4bc5cd0-aed5-4588-8e65-8ea89d6b1b5a tempest-ProjectReaderTests-1407980028 None] Lock "cinder-83be0994-136e-4bd8-b63e-8beef33d5dc0-delete_snapshot" released by "delete_snapshot" :: held 1.759s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info" returned: 0 in 0.302s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:20 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info is being set with open permissions: ugo+rw Aug 05 15:55:20 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:20 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info Aug 05 15:55:20 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:20 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.info" returned: 0 in 0.237s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:21 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-533b3fbc-841b-4265-97f6-cf824c677118 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-158dc8d1-8b99-43ad-9018-0bf1e2313e64-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Lock "cinder-158dc8d1-8b99-43ad-9018-0bf1e2313e64-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Acquiring lock "cinder-quobyte-158dc8d1-8b99-43ad-9018-0bf1e2313e64" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-158dc8d1-8b99-43ad-9018-0bf1e2313e64" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c8f553-1c08-4632-bdf0-30b5337731b2]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:21 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 Aug 05 15:55:21 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:21 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64" returned: 0 in 0.377s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:21 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64 Aug 05 15:55:21 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:21 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-158dc8d1-8b99-43ad-9018-0bf1e2313e64" returned: 0 in 0.240s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Lock "cinder-quobyte-158dc8d1-8b99-43ad-9018-0bf1e2313e64" released by "delete_volume" :: held 0.673s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:21 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Created reservations ['97db0f13-1f2a-44e3-a83c-86c6b979ad19', 'a2f2aa96-8782-4eb1-9da9-5452be2e1aa4', '8e400e35-49ff-4fa8-aebb-47ba78c826e5', 'f76926f1-346f-42b1-a80f-60d90c9ac488'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:22 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:22 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-ca07543e-9a2c-4df1-a61d-d3ce20b3e7be-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Lock "cinder-ca07543e-9a2c-4df1-a61d-d3ce20b3e7be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-0a06ae26-2c9c-43a2-9643-26a81b0f2527" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-0a06ae26-2c9c-43a2-9643-26a81b0f2527" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot ca07543e-9a2c-4df1-a61d-d3ce20b3e7be of volume 0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ae6758-ecda-4b33-be34-e808ef332295]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:22 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be Aug 05 15:55:22 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:22 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:22 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Deleted volume successfully. Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f57e12f0-35c6-4a53-a7d4-816835bf94bd tempest-ProjectReaderTests-1407980028 None] Lock "cinder-158dc8d1-8b99-43ad-9018-0bf1e2313e64-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:22 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" returned: 0 in 0.400s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f42c76c-63e2-4bc3-b658-daf3bd1df26d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:22 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 Aug 05 15:55:22 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:22 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527" returned: 0 in 0.368s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:22 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:22 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be Aug 05 15:55:22 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:23 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" returned: 0 in 0.404s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:23 devstack sudo[109362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be Aug 05 15:55:23 devstack sudo[109362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:23 devstack sudo[109362]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527.ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" returned: 0 in 0.264s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-ca07543e-9a2c-4df1-a61d-d3ce20b3e7be" released by "_delete_snapshot" :: held 1.539s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-0a06ae26-2c9c-43a2-9643-26a81b0f2527" released by "delete_snapshot" :: held 1.566s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Created reservations ['37a08c03-6ddb-4190-a4b4-05ac8e3cfcc4', 'b2a2e114-d222-42a3-9551-4f34d15347a9', 'ec75a713-c011-4ca7-9cb1-e41b2751681d', '59c4ea6e-adbe-48f5-87a2-af6de6a796ea'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:23 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:55:23 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-eda5839a-5ce7-410e-bbeb-d6ecffe7e1e2 tempest-ProjectMemberTests-514781381 None] Lock "cinder-ca07543e-9a2c-4df1-a61d-d3ce20b3e7be-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-0a06ae26-2c9c-43a2-9643-26a81b0f2527-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Lock "cinder-0a06ae26-2c9c-43a2-9643-26a81b0f2527-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-0a06ae26-2c9c-43a2-9643-26a81b0f2527" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-0a06ae26-2c9c-43a2-9643-26a81b0f2527" acquired by "delete_volume" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[6899a364-3e7a-4788-8e62-5c37ef79f60d]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:24 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 Aug 05 15:55:24 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:24 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527" returned: 0 in 0.384s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:24 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:24 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527 Aug 05 15:55:24 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:25 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-0a06ae26-2c9c-43a2-9643-26a81b0f2527" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-0a06ae26-2c9c-43a2-9643-26a81b0f2527" released by "delete_volume" :: held 0.713s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Created reservations ['3fcf59ed-7419-40e1-9b23-0bdad9aabc50', 'c329d236-ac77-4f1c-8630-b3a21d47a856', '1a4263d9-fd15-4171-9557-eb8c0068517a', 'dacea8fd-d09e-485e-bbd8-9f02c6f26329'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:25 devstack sudo[109373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:25 devstack sudo[109373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:25 devstack sudo[109373]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.275s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:25 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-2a6609a8-4f62-4fff-80d4-453a4156a7cd tempest-ProjectMemberTests-514781381 None] Lock "cinder-0a06ae26-2c9c-43a2-9643-26a81b0f2527-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (33f56359-9ca3-4a42-8463-b5de9a3affb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660f6d69-2b15-4012-a244-cecbb3e30018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660f6d69-2b15-4012-a244-cecbb3e30018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-635677370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f69abe-c7fd-448e-b63f-e4925c340002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:26Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed59b31e-a46d-48cd-86d5-82248015b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed59b31e-a46d-48cd-86d5-82248015b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44de14f-372c-4928-beea-c857979b9e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44de14f-372c-4928-beea-c857979b9e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f69abe-c7fd-448e-b63f-e4925c340002', 'volume_name': 'volume-f2f69abe-c7fd-448e-b63f-e4925c340002', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95228ac-d80f-456a-a5e0-7a758056a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b95228ac-d80f-456a-a5e0-7a758056a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0671e3-6258-43e8-bbdf-9574c761bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:25 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Volume f2f69abe-c7fd-448e-b63f-e4925c340002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f69abe-c7fd-448e-b63f-e4925c340002', 'volume_size': 1} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-635677370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f69abe-c7fd-448e-b63f-e4925c340002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:26Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Creating volume f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:25 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:25 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:26 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 1073741824 Aug 05 15:55:26 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:26 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 1073741824" returned: 0 in 0.503s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:26 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 Aug 05 15:55:26 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:26 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002" returned: 0 in 0.288s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0671e3-6258-43e8-bbdf-9574c761bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f69abe-c7fd-448e-b63f-e4925c340002', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60915df9-1af1-460d-9786-829830dd2a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:26 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Volume volume-f2f69abe-c7fd-448e-b63f-e4925c340002 (f2f69abe-c7fd-448e-b63f-e4925c340002): created successfully Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60915df9-1af1-460d-9786-829830dd2a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:26 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (33f56359-9ca3-4a42-8463-b5de9a3affb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:26 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-fc3299ca-6b04-4e99-909a-6e805b9d4a3e tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot 26489ca8-6124-4864-8367-9f18894f808d of volume f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[99975e98-2828-4546-876e-9baddc301c87]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:28 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 Aug 05 15:55:28 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:28 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002" returned: 0 in 0.400s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:28 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:28 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d 1G Aug 05 15:55:28 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:29 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d 1G" returned: 0 in 0.430s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f69abe-c7fd-448e-b63f-e4925c340002 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:29 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f69abe-c7fd-448e-b63f-e4925c340002 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d Aug 05 15:55:29 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:29 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2f69abe-c7fd-448e-b63f-e4925c340002 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d" returned: 0 in 0.313s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:29 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d is being set with open permissions: ugo+rw Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:29 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d Aug 05 15:55:29 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:29 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d" returned: 0 in 0.248s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:29 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info Aug 05 15:55:29 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:29 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:29 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info is being set with open permissions: ugo+rw Aug 05 15:55:29 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:29 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info Aug 05 15:55:29 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:30 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.info" returned: 0 in 0.264s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:30 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:30 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-d459128d-29d5-4520-ba54-cb938ba689b9 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-26489ca8-6124-4864-8367-9f18894f808d-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Lock "cinder-26489ca8-6124-4864-8367-9f18894f808d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-f2f69abe-c7fd-448e-b63f-e4925c340002" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f2f69abe-c7fd-448e-b63f-e4925c340002" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-26489ca8-6124-4864-8367-9f18894f808d" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-26489ca8-6124-4864-8367-9f18894f808d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot 26489ca8-6124-4864-8367-9f18894f808d of volume f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[5130b7bc-499f-47c9-9724-f987fe4d8c8c]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:31 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d Aug 05 15:55:31 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:31 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d" returned: 0 in 0.366s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2f69abe-c7fd-448e-b63f-e4925c340002(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[12633019-9e20-49cd-8ff5-1f8b51714201]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:31 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:31 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 Aug 05 15:55:31 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:32 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002" returned: 0 in 0.390s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:32 devstack sudo[109423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d Aug 05 15:55:32 devstack sudo[109423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:32 devstack sudo[109423]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d" returned: 0 in 0.373s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:32 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d Aug 05 15:55:32 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:32 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002.26489ca8-6124-4864-8367-9f18894f808d" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-26489ca8-6124-4864-8367-9f18894f808d" released by "_delete_snapshot" :: held 1.491s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:32 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f2f69abe-c7fd-448e-b63f-e4925c340002" released by "delete_snapshot" :: held 1.519s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Created reservations ['150200af-adbe-4d89-817b-166e013efb9d', '0aaf3859-15a4-4c56-9c51-8cc9c6223291', '11979aff-e51a-4651-ae8c-f6ced9bffc3e', '908ba4c3-a91f-4581-96d6-018aa3316b1e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:33 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-408e422b-bd71-47e4-b792-5e76f992b278 tempest-ProjectMemberTests-514781381 None] Lock "cinder-26489ca8-6124-4864-8367-9f18894f808d-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-f2f69abe-c7fd-448e-b63f-e4925c340002-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Lock "cinder-f2f69abe-c7fd-448e-b63f-e4925c340002-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-f2f69abe-c7fd-448e-b63f-e4925c340002" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f2f69abe-c7fd-448e-b63f-e4925c340002" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca9c30e-0b9e-413e-a6cf-b3aad5420d14]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:33 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:33 devstack sudo[109431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 Aug 05 15:55:33 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:34 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002" returned: 0 in 0.398s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:34 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002 Aug 05 15:55:34 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:34 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f2f69abe-c7fd-448e-b63f-e4925c340002" returned: 0 in 0.272s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f2f69abe-c7fd-448e-b63f-e4925c340002" released by "delete_volume" :: held 0.733s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:DELETE=18,cinder:UPDATE=254,cinder:SELECT=197,cinder:INSERT=63 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Created reservations ['f40d9cad-db53-46c3-9f4f-d29bc861382c', 'fc717895-971d-444c-a604-44634e5973ba', '407fc82d-fb07-44d1-8896-d65aea9c24bd', '2babff41-3974-46b1-853e-3dbad51463b3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:34 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:34 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:34 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.281s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:34 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:55:34 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e61d8d1-384d-4542-8ac3-74137de4dffd tempest-ProjectMemberTests-514781381 None] Lock "cinder-f2f69abe-c7fd-448e-b63f-e4925c340002-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (630b85ea-5c30-4858-b2e3-9eaaf0cef98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c97df3c-96f1-4a00-9695-41c73dace86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c97df3c-96f1-4a00-9695-41c73dace86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344602265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d68161-afcf-4d6c-b0d3-93d10b9df74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:35Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21661d10-922c-467a-901e-5da0acbacd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21661d10-922c-467a-901e-5da0acbacd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db19e17a-292f-458b-9205-360dfeda6cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db19e17a-292f-458b-9205-360dfeda6cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d68161-afcf-4d6c-b0d3-93d10b9df74e', 'volume_name': 'volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc7e03a-c47b-4b68-a9ae-7c7d350a22ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc7e03a-c47b-4b68-a9ae-7c7d350a22ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d58c348-eb6a-44c7-b72a-116a3aabfff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:35 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Volume 58d68161-afcf-4d6c-b0d3-93d10b9df74e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e', 'volume_size': 1} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1344602265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d68161-afcf-4d6c-b0d3-93d10b9df74e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:35Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Creating volume 58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:35 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:35 devstack sudo[109442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e 1073741824 Aug 05 15:55:35 devstack sudo[109442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:35 devstack sudo[109442]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e 1073741824" returned: 0 in 0.525s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:35 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:35 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e Aug 05 15:55:35 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:36 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e" returned: 0 in 0.293s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d58c348-eb6a-44c7-b72a-116a3aabfff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc12c48-6989-4e19-8dcc-753e2c79c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:36 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Volume volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e (58d68161-afcf-4d6c-b0d3-93d10b9df74e): created successfully Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc12c48-6989-4e19-8dcc-753e2c79c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:36 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (630b85ea-5c30-4858-b2e3-9eaaf0cef98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:36 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-1a759382-6e0f-47f7-bde7-4893fc67bd13 tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:37 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot 1e2fed29-f75a-4836-8cce-0fb9420fbb94 of volume 58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:37 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e4d12-e131-4062-b5ce-1911a87ea1f4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:37 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:37 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e Aug 05 15:55:37 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:38 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e" returned: 0 in 0.377s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:38 devstack sudo[109457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 1G Aug 05 15:55:38 devstack sudo[109457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:38 devstack sudo[109457]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 1G" returned: 0 in 0.461s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:38 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 Aug 05 15:55:38 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:38 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94" returned: 0 in 0.347s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:38 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 is being set with open permissions: ugo+rw Aug 05 15:55:38 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:38 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 Aug 05 15:55:38 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:39 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94" returned: 0 in 0.346s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:39 devstack sudo[109470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info Aug 05 15:55:39 devstack sudo[109470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:39 devstack sudo[109470]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info" returned: 0 in 0.305s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:39 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info is being set with open permissions: ugo+rw Aug 05 15:55:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:39 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info Aug 05 15:55:39 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:39 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.info" returned: 0 in 0.266s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:39 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:39 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6afe6175-0ac3-4226-95f3-4f6b0a64fd39 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-1e2fed29-f75a-4836-8cce-0fb9420fbb94-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Lock "cinder-1e2fed29-f75a-4836-8cce-0fb9420fbb94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-58d68161-afcf-4d6c-b0d3-93d10b9df74e" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-58d68161-afcf-4d6c-b0d3-93d10b9df74e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-1e2fed29-f75a-4836-8cce-0fb9420fbb94" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-1e2fed29-f75a-4836-8cce-0fb9420fbb94" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot 1e2fed29-f75a-4836-8cce-0fb9420fbb94 of volume 58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abc2f68-ca8f-497f-84ad-82f7d0c6721f]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:40 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:40 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 Aug 05 15:55:40 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:41 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94" returned: 0 in 0.379s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[be504669-4eb8-492f-aafa-4b7a3afd6bdd]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:41 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e Aug 05 15:55:41 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:41 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e" returned: 0 in 0.373s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:41 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 Aug 05 15:55:41 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:41 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94" returned: 0 in 0.357s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:41 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:42 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94 Aug 05 15:55:42 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:42 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e.1e2fed29-f75a-4836-8cce-0fb9420fbb94" returned: 0 in 0.259s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-1e2fed29-f75a-4836-8cce-0fb9420fbb94" released by "_delete_snapshot" :: held 1.468s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-58d68161-afcf-4d6c-b0d3-93d10b9df74e" released by "delete_snapshot" :: held 1.489s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Created reservations ['adc1d5b2-eff7-43e3-94b8-150757385900', 'a1b4fbff-5f93-4d0b-9d87-bae7e2881424', '3b321c92-b0cb-4dc6-b825-06f5f7951cd9', '5c21ee23-e159-43a6-8069-ecaad6fb36b6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:42 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a98bd8cc-734d-4169-a557-d6a1fdc3e876 tempest-ProjectMemberTests-514781381 None] Lock "cinder-1e2fed29-f75a-4836-8cce-0fb9420fbb94-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-58d68161-afcf-4d6c-b0d3-93d10b9df74e-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Lock "cinder-58d68161-afcf-4d6c-b0d3-93d10b9df74e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:42 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-58d68161-afcf-4d6c-b0d3-93d10b9df74e" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-58d68161-afcf-4d6c-b0d3-93d10b9df74e" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652b028-555f-4e8c-b335-4c59434214ad]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:43 devstack sudo[109496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e Aug 05 15:55:43 devstack sudo[109496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:43 devstack sudo[109496]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e" returned: 0 in 0.378s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:43 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e Aug 05 15:55:43 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:43 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-58d68161-afcf-4d6c-b0d3-93d10b9df74e" returned: 0 in 0.238s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-58d68161-afcf-4d6c-b0d3-93d10b9df74e" released by "delete_volume" :: held 0.676s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Created reservations ['05217948-b7ae-40dc-b4b9-717be9bd98b1', '61585644-d38c-47da-b541-37dd5d369b3e', '33673a29-67c2-47b8-ac13-9e460fc7f085', 'a97bf7f0-9029-428b-92a4-689e9e621cc6'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:43 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:43 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:43 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:44 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.257s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:44 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-a2d792a7-c221-41bc-8b00-be0c2970221a tempest-ProjectMemberTests-514781381 None] Lock "cinder-58d68161-afcf-4d6c-b0d3-93d10b9df74e-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=177,cinder:INSERT=68,cinder:UPDATE=239,cinder:DELETE=18 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (4477c7e2-2157-4862-a4d8-51a5adb1581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0a751d-5e52-415a-b96a-e6a80692e52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0a751d-5e52-415a-b96a-e6a80692e52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279816593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba2b39c-a274-4951-94f3-c49bb7d31469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:45Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13730a1a-9ca3-4bae-bee7-d875231bb5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13730a1a-9ca3-4bae-bee7-d875231bb5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7149a955-af1e-49ed-852e-81973e56a993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7149a955-af1e-49ed-852e-81973e56a993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fba2b39c-a274-4951-94f3-c49bb7d31469', 'volume_name': 'volume-fba2b39c-a274-4951-94f3-c49bb7d31469', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104a0db-ce72-41ef-95d5-41fff4dbe7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3104a0db-ce72-41ef-95d5-41fff4dbe7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3070c3c-1534-434a-9816-2e1a096c84f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:44 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Volume fba2b39c-a274-4951-94f3-c49bb7d31469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fba2b39c-a274-4951-94f3-c49bb7d31469', 'volume_size': 1} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-279816593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba2b39c-a274-4951-94f3-c49bb7d31469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:45Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Creating volume fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:44 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:44 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:44 devstack sudo[109508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 1073741824 Aug 05 15:55:44 devstack sudo[109508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:45 devstack sudo[109508]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 1073741824" returned: 0 in 0.455s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:45 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 Aug 05 15:55:45 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:45 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469" returned: 0 in 0.248s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3070c3c-1534-434a-9816-2e1a096c84f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba2b39c-a274-4951-94f3-c49bb7d31469', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b811b6ed-978d-4d99-b402-2eac549d46df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:45 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Volume volume-fba2b39c-a274-4951-94f3-c49bb7d31469 (fba2b39c-a274-4951-94f3-c49bb7d31469): created successfully Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b811b6ed-978d-4d99-b402-2eac549d46df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:45 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (4477c7e2-2157-4862-a4d8-51a5adb1581a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:45 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-27480cf3-b194-43b6-a6f8-aad5d5ffd3da tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:46 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Creating offline snapshot af1bf314-01eb-4931-b09f-1422b3bb55d2 of volume fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:46 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dcf6a4-2e23-438e-adb4-6e90ff573e60]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:46 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:47 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 Aug 05 15:55:47 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:47 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469" returned: 0 in 0.429s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:47 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 1G Aug 05 15:55:47 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:47 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 1G" returned: 0 in 0.396s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:47 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba2b39c-a274-4951-94f3-c49bb7d31469 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:47 devstack sudo[109530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba2b39c-a274-4951-94f3-c49bb7d31469 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 Aug 05 15:55:47 devstack sudo[109530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:48 devstack sudo[109530]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fba2b39c-a274-4951-94f3-c49bb7d31469 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2" returned: 0 in 0.314s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:48 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 is being set with open permissions: ugo+rw Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:48 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 Aug 05 15:55:48 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:48 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2" returned: 0 in 0.243s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:48 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info Aug 05 15:55:48 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:48 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info" returned: 0 in 0.270s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:48 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info is being set with open permissions: ugo+rw Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:48 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info Aug 05 15:55:48 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:48 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.info" returned: 0 in 0.274s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:48 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.035s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:48 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-b870f6a7-edc1-46a7-9157-7b730ebeb12b tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-af1bf314-01eb-4931-b09f-1422b3bb55d2-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Lock "cinder-af1bf314-01eb-4931-b09f-1422b3bb55d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-fba2b39c-a274-4951-94f3-c49bb7d31469" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-fba2b39c-a274-4951-94f3-c49bb7d31469" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-af1bf314-01eb-4931-b09f-1422b3bb55d2" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-af1bf314-01eb-4931-b09f-1422b3bb55d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot af1bf314-01eb-4931-b09f-1422b3bb55d2 of volume fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b2e98-5531-427b-8e70-f7114cfffc50]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:50 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 Aug 05 15:55:50 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Flow 'volume_create_manager' (6f0d4a7c-207b-4e29-b274-c687bb91b65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531c964-ccd7-43ca-a819-003794f24a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8531c964-ccd7-43ca-a819-003794f24a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-195789673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28737870-5549-4567-8ee9-cd8c988e6175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02746f3252964d8d9746356d32ae47bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:50Z,use_quota=True,user_id='46691fe38c72499f8fe986901c69f2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938bde99-976e-4266-99a5-09c0f454dd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (938bde99-976e-4266-99a5-09c0f454dd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62c695b-d640-4a68-b687-ddde31163e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:50 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62c695b-d640-4a68-b687-ddde31163e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28737870-5549-4567-8ee9-cd8c988e6175', 'volume_name': 'volume-28737870-5549-4567-8ee9-cd8c988e6175', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b123af82-7330-4639-8697-8dc7215eb241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b123af82-7330-4639-8697-8dc7215eb241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cb8e0-79c9-4c91-b5b2-6199a51d2062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:50 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Volume 28737870-5549-4567-8ee9-cd8c988e6175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28737870-5549-4567-8ee9-cd8c988e6175', 'volume_size': 1} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-195789673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28737870-5549-4567-8ee9-cd8c988e6175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02746f3252964d8d9746356d32ae47bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:50Z,use_quota=True,user_id='46691fe38c72499f8fe986901c69f2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Creating volume 28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:50 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2" returned: 0 in 0.393s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fba2b39c-a274-4951-94f3-c49bb7d31469(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:50 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 1073741824 Aug 05 15:55:50 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e56c9-b8f0-48c5-87d8-6e8b9afb4d29]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:50 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 Aug 05 15:55:50 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469" returned: 0 in 0.346s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:50 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 1073741824" returned: 0 in 0.403s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:50 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 Aug 05 15:55:50 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:50 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:51 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 Aug 05 15:55:51 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:51 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175" returned: 0 in 0.239s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833cb8e0-79c9-4c91-b5b2-6199a51d2062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28737870-5549-4567-8ee9-cd8c988e6175', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9205697d-9e41-44e2-89b6-cfe418196bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:51 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2" returned: 0 in 0.325s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:51 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Volume volume-28737870-5549-4567-8ee9-cd8c988e6175 (28737870-5549-4567-8ee9-cd8c988e6175): created successfully Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9205697d-9e41-44e2-89b6-cfe418196bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Flow 'volume_create_manager' (6f0d4a7c-207b-4e29-b274-c687bb91b65e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:51 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2 Aug 05 15:55:51 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-9145c9c0-fdad-4773-924d-ddafdfc439be tempest-SnapshotDependencyTests-282465515 None] Created volume successfully. Aug 05 15:55:51 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469.af1bf314-01eb-4931-b09f-1422b3bb55d2" returned: 0 in 0.240s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-af1bf314-01eb-4931-b09f-1422b3bb55d2" released by "_delete_snapshot" :: held 1.395s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-fba2b39c-a274-4951-94f3-c49bb7d31469" released by "delete_snapshot" :: held 1.427s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Created reservations ['834289fa-8f1f-4ca1-aac7-319bbcc4308f', 'bcafef86-00b6-42b2-82bd-454b322a75f1', 'ae2e44bd-fa48-4e08-80fe-3fe55226d32c', 'accfdf62-b59c-4e54-b92f-b0c8d552be33'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:51 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-559851b9-9e1a-48de-a978-8ea8bfa9af43 tempest-ProjectMemberTests-514781381 None] Lock "cinder-af1bf314-01eb-4931-b09f-1422b3bb55d2-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Creating offline snapshot 82cffc33-53c3-43cb-ad62-ac90a875dbca of volume 28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec494612-b973-4e43-9706-b660802b68d5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:51 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:51 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 Aug 05 15:55:51 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175" returned: 0 in 0.335s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca 1G Aug 05 15:55:52 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-fba2b39c-a274-4951-94f3-c49bb7d31469-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Lock "cinder-fba2b39c-a274-4951-94f3-c49bb7d31469-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-fba2b39c-a274-4951-94f3-c49bb7d31469" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-fba2b39c-a274-4951-94f3-c49bb7d31469" acquired by "delete_volume" :: waited 0.021s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d4517a-c984-47ac-aed8-7ef7a5361fe3]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[109585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 Aug 05 15:55:52 devstack sudo[109585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca 1G" returned: 0 in 0.450s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28737870-5549-4567-8ee9-cd8c988e6175 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28737870-5549-4567-8ee9-cd8c988e6175 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca Aug 05 15:55:52 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack sudo[109585]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469" returned: 0 in 0.366s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469 Aug 05 15:55:52 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28737870-5549-4567-8ee9-cd8c988e6175 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca" returned: 0 in 0.278s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:52 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca is being set with open permissions: ugo+rw Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:52 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca Aug 05 15:55:52 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:52 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:52 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-fba2b39c-a274-4951-94f3-c49bb7d31469" returned: 0 in 0.245s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-fba2b39c-a274-4951-94f3-c49bb7d31469" released by "delete_volume" :: held 0.670s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:53 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Created reservations ['ba07739e-aae2-42ad-85c7-5fc8cf9505a4', '9ec48fef-6fad-4822-b4d4-ce811bf2de55', 'f03914e7-9ecc-4069-b30f-d627679bdff3', '4a87ec2c-d14a-474e-837f-e7f0d0fac599'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:55:53 devstack sudo[109602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info Aug 05 15:55:53 devstack sudo[109602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:53 devstack sudo[109604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:55:53 devstack sudo[109604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:53 devstack sudo[109602]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info" returned: 0 in 0.242s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info is being set with open permissions: ugo+rw Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:53 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info Aug 05 15:55:53 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:53 devstack sudo[109604]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.252s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:55:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-f3b09601-d4a0-46f1-b1e0-639230cfd0ea tempest-ProjectMemberTests-514781381 None] Lock "cinder-fba2b39c-a274-4951-94f3-c49bb7d31469-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:53 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.info" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:53 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-2dd447dd-a2b5-4c9a-a7ed-00bdfcbba018 tempest-SnapshotDependencyTests-282465515 None] Create snapshot completed successfully Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (6908fc09-b2c1-40b8-8889-e358d56fb616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c62e9e5-e004-47f5-be3b-fab7bbe5edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c62e9e5-e004-47f5-be3b-fab7bbe5edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749078417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3992d74-68a3-4676-a1c6-d841f78447a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:54Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a42e90-89ec-4dc7-a56e-57646f02e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a42e90-89ec-4dc7-a56e-57646f02e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5fae30-aefc-4247-885b-3ac0c5b8a62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5fae30-aefc-4247-885b-3ac0c5b8a62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3992d74-68a3-4676-a1c6-d841f78447a8', 'volume_name': 'volume-f3992d74-68a3-4676-a1c6-d841f78447a8', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31033bf0-0d5e-4f66-8ecc-d8e25535a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31033bf0-0d5e-4f66-8ecc-d8e25535a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15960b0e-4a25-4686-bcca-9891fb6701fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:53 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Volume f3992d74-68a3-4676-a1c6-d841f78447a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3992d74-68a3-4676-a1c6-d841f78447a8', 'volume_size': 1} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-749078417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3992d74-68a3-4676-a1c6-d841f78447a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:54Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Creating volume f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:53 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:55:53 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:54 devstack sudo[109611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 1073741824 Aug 05 15:55:54 devstack sudo[109611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:55:54 devstack sudo[109611]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Flow 'volume_create_manager' (7f75fe24-0c12-4365-8a53-9b00f0d0ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e7700a-f3a0-4bce-896b-48d794019dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 1073741824" returned: 0 in 0.462s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e7700a-f3a0-4bce-896b-48d794019dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:55:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b926c12e-3efe-48d4-8f07-c5ed5c097668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02746f3252964d8d9746356d32ae47bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=82cffc33-53c3-43cb-ad62-ac90a875dbca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:55:54Z,use_quota=True,user_id='46691fe38c72499f8fe986901c69f2a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187f92bd-6e40-48ea-bd7e-a00e54e88824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187f92bd-6e40-48ea-bd7e-a00e54e88824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ffabc8-1e36-483d-aece-a024ebb57a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ffabc8-1e36-483d-aece-a024ebb57a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b926c12e-3efe-48d4-8f07-c5ed5c097668', 'volume_name': 'volume-b926c12e-3efe-48d4-8f07-c5ed5c097668', 'volume_size': 1, 'snapshot_id': '82cffc33-53c3-43cb-ad62-ac90a875dbca'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61460fd6-8f96-4b53-b379-72a4a41aaaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61460fd6-8f96-4b53-b379-72a4a41aaaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76ea42d-9350-4917-b077-7f6b79e8872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:54 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Volume b926c12e-3efe-48d4-8f07-c5ed5c097668: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b926c12e-3efe-48d4-8f07-c5ed5c097668', 'volume_size': 1, 'snapshot_id': '82cffc33-53c3-43cb-ad62-ac90a875dbca'} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:54 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 Aug 05 15:55:54 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:54 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8" returned: 0 in 0.235s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.256s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-quobyte-82cffc33-53c3-43cb-ad62-ac90a875dbca-b926c12e-3efe-48d4-8f07-c5ed5c097668" by "_create_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15960b0e-4a25-4686-bcca-9891fb6701fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3992d74-68a3-4676-a1c6-d841f78447a8', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46bd528-9ca8-4833-ac20-26f7e3e18061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-82cffc33-53c3-43cb-ad62-ac90a875dbca-b926c12e-3efe-48d4-8f07-c5ed5c097668" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Creating volume b926c12e-3efe-48d4-8f07-c5ed5c097668 from snapshot 82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-quobyte-b926c12e-3efe-48d4-8f07-c5ed5c097668" by "_copy_volume_from_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:54 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Volume volume-f3992d74-68a3-4676-a1c6-d841f78447a8 (f3992d74-68a3-4676-a1c6-d841f78447a8): created successfully Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46bd528-9ca8-4833-ac20-26f7e3e18061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (6908fc09-b2c1-40b8-8889-e358d56fb616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-b926c12e-3efe-48d4-8f07-c5ed5c097668" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] snapshot: 82cffc33-53c3-43cb-ad62-ac90a875dbca, volume: b926c12e-3efe-48d4-8f07-c5ed5c097668, {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 05 15:55:54 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-bf0d632c-24bb-45bb-b9a8-4e6a0ce7f54a tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ee2aa7-82b9-4515-989b-415b27a83f4b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:54 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:54 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca Aug 05 15:55:54 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:55 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca" returned: 0 in 0.339s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28737870-5549-4567-8ee9-cd8c988e6175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[d173fbae-20a4-4ef7-9888-b93828776aaf]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:55 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 Aug 05 15:55:55 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:55 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175" returned: 0 in 0.337s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Creating direct copy from snapshot {{(pid=88999) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG cinder.utils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Path /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 not found in is_blk_device check {{(pid=88999) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 05 15:55:55 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:55 devstack sudo[109630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 Aug 05 15:55:55 devstack sudo[109630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:56 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:55:59 devstack sudo[109630]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668" returned: 0 in 3.792s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.image.image_utils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Image conversion details: src /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175, size 1024.00 MB, duration 3.79 sec, destination /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 {{(pid=88999) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 05 15:55:59 devstack cinder-volume[88999]: INFO cinder.image.image_utils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Converted 1024.00 MB image at 269.98 MB/s Aug 05 15:55:59 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 is being set with open permissions: ugo+rw Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:59 devstack sudo[109643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 Aug 05 15:55:59 devstack sudo[109643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:59 devstack sudo[109643]: pam_unix(sudo:session): session closed for user root Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668" returned: 0 in 0.229s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-b926c12e-3efe-48d4-8f07-c5ed5c097668" released by "_copy_volume_from_snapshot" :: held 4.779s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-82cffc33-53c3-43cb-ad62-ac90a875dbca-b926c12e-3efe-48d4-8f07-c5ed5c097668" released by "_create_volume_from_snapshot" :: held 4.851s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.885s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.466s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot 5c7dfe32-e14e-4c37-a918-5b082b006de8 of volume f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76ea42d-9350-4917-b077-7f6b79e8872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b926c12e-3efe-48d4-8f07-c5ed5c097668', 'volume_size': 1, 'snapshot_id': '82cffc33-53c3-43cb-ad62-ac90a875dbca'}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f852c6-44a2-46fc-8096-e3d0394c1d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6dc5e1-3953-43d7-bfec-269775a24752]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:55:59 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Volume volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 (b926c12e-3efe-48d4-8f07-c5ed5c097668): created successfully Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f852c6-44a2-46fc-8096-e3d0394c1d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Flow 'volume_create_manager' (7f75fe24-0c12-4365-8a53-9b00f0d0ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:55:59 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-72a996d6-0704-4b21-9c51-33c06773fc62 tempest-SnapshotDependencyTests-282465515 None] Created volume successfully. Aug 05 15:55:59 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 Aug 05 15:55:59 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-82cffc33-53c3-43cb-ad62-ac90a875dbca-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-82cffc33-53c3-43cb-ad62-ac90a875dbca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-quobyte-28737870-5549-4567-8ee9-cd8c988e6175" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-28737870-5549-4567-8ee9-cd8c988e6175" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-quobyte-82cffc33-53c3-43cb-ad62-ac90a875dbca" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-82cffc33-53c3-43cb-ad62-ac90a875dbca" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:55:59 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Deleting offline snapshot 82cffc33-53c3-43cb-ad62-ac90a875dbca of volume 28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] snapshot_file for this snap is: volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[28212702-c3eb-4d1d-90af-205d566a3d18]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:00 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8" returned: 0 in 0.397s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:00 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca Aug 05 15:56:00 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:00 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 1G Aug 05 15:56:00 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:00 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca" returned: 0 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28737870-5549-4567-8ee9-cd8c988e6175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e70705-efe1-4bd5-9965-5bfbfadbaa70]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:00 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 Aug 05 15:56:00 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:00 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 1G" returned: 0 in 0.435s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3992d74-68a3-4676-a1c6-d841f78447a8 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:00 devstack sudo[109664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3992d74-68a3-4676-a1c6-d841f78447a8 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 Aug 05 15:56:00 devstack sudo[109664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:00 devstack sudo[109664]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3992d74-68a3-4676-a1c6-d841f78447a8 -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:00 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 is being set with open permissions: ugo+rw Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:00 devstack sudo[109671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 Aug 05 15:56:00 devstack sudo[109671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:00 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175" returned: 0 in 0.529s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:00 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:00 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca Aug 05 15:56:00 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:01 devstack sudo[109671]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8" returned: 0 in 0.236s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:01 devstack sudo[109677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info Aug 05 15:56:01 devstack sudo[109677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:01 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca" returned: 0 in 0.338s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:01 devstack sudo[109683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca Aug 05 15:56:01 devstack sudo[109683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:01 devstack sudo[109677]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info" returned: 0 in 0.248s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:01 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info is being set with open permissions: ugo+rw Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:01 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info Aug 05 15:56:01 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:01 devstack sudo[109683]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175.82cffc33-53c3-43cb-ad62-ac90a875dbca" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-82cffc33-53c3-43cb-ad62-ac90a875dbca" released by "_delete_snapshot" :: held 1.587s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-28737870-5549-4567-8ee9-cd8c988e6175" released by "delete_snapshot" :: held 1.618s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:01 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.info" returned: 0 in 0.273s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.943s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4f156adf-e9f1-45d9-9155-de2343535cb7 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Created reservations ['a2705c0e-5665-495b-9ea2-7ba63b312fab', '88bd5ced-6752-42db-9ed3-743ba47e684a', '20b382d8-5afc-4e10-8018-85b891523e75', 'ee331109-2c0e-481a-b579-23b243406229'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:01 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Delete snapshot completed successfully. Aug 05 15:56:01 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-4c342604-4288-439b-a099-8db1b9ae8a65 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-82cffc33-53c3-43cb-ad62-ac90a875dbca-delete_snapshot" released by "delete_snapshot" :: held 1.791s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-28737870-5549-4567-8ee9-cd8c988e6175-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-28737870-5549-4567-8ee9-cd8c988e6175-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-quobyte-28737870-5549-4567-8ee9-cd8c988e6175" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-28737870-5549-4567-8ee9-cd8c988e6175" acquired by "delete_volume" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ca1c6a-c19b-4dff-8921-62500fef6793]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:02 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 Aug 05 15:56:02 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:02 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-5c7dfe32-e14e-4c37-a918-5b082b006de8-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175" returned: 0 in 0.392s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Lock "cinder-5c7dfe32-e14e-4c37-a918-5b082b006de8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-f3992d74-68a3-4676-a1c6-d841f78447a8" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:02 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175 Aug 05 15:56:02 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f3992d74-68a3-4676-a1c6-d841f78447a8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-5c7dfe32-e14e-4c37-a918-5b082b006de8" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-5c7dfe32-e14e-4c37-a918-5b082b006de8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot 5c7dfe32-e14e-4c37-a918-5b082b006de8 of volume f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[0965320a-db1e-4040-9f50-1cbc5c36e57b]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:02 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 Aug 05 15:56:02 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:02 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-28737870-5549-4567-8ee9-cd8c988e6175" returned: 0 in 0.254s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-28737870-5549-4567-8ee9-cd8c988e6175" released by "delete_volume" :: held 0.707s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Created reservations ['4ce478d7-5ecd-4708-a1b0-ef920ec664c3', 'd1833cb1-3e6d-4047-b7df-60bb2f8fe867', 'e00946c8-9437-44ad-a4dd-441a1fcc49ac', 'b25d6604-67b2-44f7-ae67-6de903d57f65'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:02 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[109699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:56:03 devstack sudo[109699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:03 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8" returned: 0 in 0.382s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3992d74-68a3-4676-a1c6-d841f78447a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bbae40-d0ef-4439-b414-1c4bbde0870e]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[109704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 Aug 05 15:56:03 devstack sudo[109704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:03 devstack sudo[109699]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.271s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-b926c12e-3efe-48d4-8f07-c5ed5c097668-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:03 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Deleted volume successfully. Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-b926c12e-3efe-48d4-8f07-c5ed5c097668-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-44a21969-a0ab-4c7f-abf3-d52476129618 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-28737870-5549-4567-8ee9-cd8c988e6175-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "cinder-quobyte-b926c12e-3efe-48d4-8f07-c5ed5c097668" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-b926c12e-3efe-48d4-8f07-c5ed5c097668" acquired by "delete_volume" :: waited 0.014s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[972df529-2f8a-45ed-b1b6-6ff4318a4ae5]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[109704]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8" returned: 0 in 0.397s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 Aug 05 15:56:03 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:03 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 Aug 05 15:56:03 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:03 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668" returned: 0 in 0.381s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[109720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668 Aug 05 15:56:03 devstack sudo[109720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:03 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8" returned: 0 in 0.356s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:03 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:03 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8 Aug 05 15:56:03 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:04 devstack sudo[109720]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-b926c12e-3efe-48d4-8f07-c5ed5c097668" returned: 0 in 0.265s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-quobyte-b926c12e-3efe-48d4-8f07-c5ed5c097668" released by "delete_volume" :: held 0.692s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:04 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8.5c7dfe32-e14e-4c37-a918-5b082b006de8" returned: 0 in 0.243s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-5c7dfe32-e14e-4c37-a918-5b082b006de8" released by "_delete_snapshot" :: held 1.498s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f3992d74-68a3-4676-a1c6-d841f78447a8" released by "delete_snapshot" :: held 1.525s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Created reservations ['881a10e7-1573-4f93-8d2d-cf7f2f64a91d', '18134c41-9912-4182-b54f-4df9a2146a65', '32a024cf-7178-4a23-85c1-0d8b2a0bd2c5', '40a5bd7f-05e4-46e7-90bd-0069985a8ae2'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Created reservations ['0a27fad3-09ae-42e0-917d-b53dc6e2913c', '92015cad-1b73-47ac-8ecf-0789d2089972', '4f24a55d-35e7-47bc-bf6b-e8b89b65466b', 'dc3466ff-feea-488b-8ca4-f665b128bb2e'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:04 devstack sudo[109726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:56:04 devstack sudo[109726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-798d716a-66be-47f3-9e20-48e745f7f9ad tempest-ProjectMemberTests-514781381 None] Lock "cinder-5c7dfe32-e14e-4c37-a918-5b082b006de8-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:04 devstack sudo[109726]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.241s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:04 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Deleted volume successfully. Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-819d754e-d2e1-449f-ae3e-c3761501aab0 tempest-SnapshotDependencyTests-282465515 None] Lock "cinder-b926c12e-3efe-48d4-8f07-c5ed5c097668-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-f3992d74-68a3-4676-a1c6-d841f78447a8-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Lock "cinder-f3992d74-68a3-4676-a1c6-d841f78447a8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-f3992d74-68a3-4676-a1c6-d841f78447a8" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f3992d74-68a3-4676-a1c6-d841f78447a8" acquired by "delete_volume" :: waited 0.017s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d293e1-1ab3-4657-a869-8be77c207aec]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:04 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:04 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 Aug 05 15:56:04 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:05 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8" returned: 0 in 0.385s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:05 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8 Aug 05 15:56:05 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:05 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-f3992d74-68a3-4676-a1c6-d841f78447a8" returned: 0 in 0.262s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-f3992d74-68a3-4676-a1c6-d841f78447a8" released by "delete_volume" :: held 0.704s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Created reservations ['dbd1ddee-89a5-434c-88d9-f8d84390832a', '473b3159-9ef8-469d-9ad9-238cffcc4a4e', '2a70c930-358d-40f9-b938-7f10d7f8f797', 'c0078737-acf1-411e-859a-7a79737aeb85'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:05 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:56:05 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:05 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.258s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:05 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:56:05 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-330404d0-2a7f-4cfa-9210-13eef5f1c15a tempest-ProjectMemberTests-514781381 None] Lock "cinder-f3992d74-68a3-4676-a1c6-d841f78447a8-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88999) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (0270b3bc-3314-4837-b0cf-bafa73f8b8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6906725c-e03b-4203-ae20-da4565a6415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6906725c-e03b-4203-ae20-da4565a6415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031655975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894dcfe0-5c10-4d51-b615-764966b5202b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:06Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cdabb2-3b76-43c6-8588-92f3704f65fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4cdabb2-3b76-43c6-8588-92f3704f65fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312fa07b-efdd-4c54-827f-523b542730c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312fa07b-efdd-4c54-827f-523b542730c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '894dcfe0-5c10-4d51-b615-764966b5202b', 'volume_name': 'volume-894dcfe0-5c10-4d51-b615-764966b5202b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef766b2b-baf8-4ed5-ba8b-941358ae9da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef766b2b-baf8-4ed5-ba8b-941358ae9da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27a53eb-cb9c-4575-af95-82918e4a8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:06 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Volume 894dcfe0-5c10-4d51-b615-764966b5202b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-894dcfe0-5c10-4d51-b615-764966b5202b', 'volume_size': 1} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-05T13:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1031655975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=894dcfe0-5c10-4d51-b615-764966b5202b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2e837a3e5a148ad90fae7abf0655644',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-05T13:56:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-05T13:56:06Z,use_quota=True,user_id='ccd88854568548f0bcda2ae4236560a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da8bdbf3-3153-4414-96d6-767e6d953750),volume_type_id=da8bdbf3-3153-4414-96d6-767e6d953750)}" {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Creating volume 894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Selected osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 as target Quobyte volume. {{(pid=88999) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 05 15:56:06 devstack cinder-volume[88999]: INFO cinder.volume.drivers.remotefs [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] casted to osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60 Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b 1073741824 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:06 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b 1073741824 Aug 05 15:56:06 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:06 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b 1073741824" returned: 0 in 0.445s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:06 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:06 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b Aug 05 15:56:06 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:07 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b" returned: 0 in 0.234s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'} {{(pid=88999) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27a53eb-cb9c-4575-af95-82918e4a8718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-894dcfe0-5c10-4d51-b615-764966b5202b', 'volume_size': 1}' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da7f54e-5e73-4c6b-9efb-5ed4c87dd77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 05 15:56:07 devstack cinder-volume[88999]: INFO cinder.volume.flows.manager.create_volume [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Volume volume-894dcfe0-5c10-4d51-b615-764966b5202b (894dcfe0-5c10-4d51-b615-764966b5202b): created successfully Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da7f54e-5e73-4c6b-9efb-5ed4c87dd77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88999) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Flow 'volume_create_manager' (0270b3bc-3314-4837-b0cf-bafa73f8b8e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88999) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 05 15:56:07 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-4ea7ffb4-f6f5-40c7-86df-6a05a669da52 tempest-ProjectMemberTests-514781381 None] Created volume successfully. Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Creating offline snapshot b80243c0-f2dd-4bf5-a778-ea828326d582 of volume 894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd34d4f-e913-4398-8e0b-abffe37b5675]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:07 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b Aug 05 15:56:07 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:07 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b" returned: 0 in 0.402s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:07 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 1G {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:08 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 1G Aug 05 15:56:08 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:08 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 1G" returned: 0 in 0.434s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894dcfe0-5c10-4d51-b615-764966b5202b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:08 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894dcfe0-5c10-4d51-b615-764966b5202b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 Aug 05 15:56:08 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:08 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-894dcfe0-5c10-4d51-b615-764966b5202b -F qcow2 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582" returned: 0 in 0.325s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:08 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 is being set with open permissions: ugo+rw Aug 05 15:56:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:08 devstack sudo[109770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 Aug 05 15:56:08 devstack sudo[109770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:08 devstack sudo[109770]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:08 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582" returned: 0 in 0.244s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:09 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info Aug 05 15:56:09 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:09 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info" returned: 0 in 0.240s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:09 devstack cinder-volume[88999]: WARNING cinder.volume.drivers.remotefs [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info is being set with open permissions: ugo+rw Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:09 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info Aug 05 15:56:09 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:09 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.info" returned: 0 in 0.256s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:09 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-3b10117b-7129-44d1-b9f7-c88fb65fc3a6 tempest-ProjectMemberTests-514781381 None] Create snapshot completed successfully Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-b80243c0-f2dd-4bf5-a778-ea828326d582-delete_snapshot" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Lock "cinder-b80243c0-f2dd-4bf5-a778-ea828326d582-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-894dcfe0-5c10-4d51-b615-764966b5202b" by "delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-894dcfe0-5c10-4d51-b615-764966b5202b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-b80243c0-f2dd-4bf5-a778-ea828326d582" by "_delete_snapshot" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-b80243c0-f2dd-4bf5-a778-ea828326d582" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Deleting offline snapshot b80243c0-f2dd-4bf5-a778-ea828326d582 of volume 894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] snapshot_file for this snap is: volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 {{(pid=88999) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eb0387-676f-4f10-b55f-6aa3c81ecbd4]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:09 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:09 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 Aug 05 15:56:09 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:10 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:56:10 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:10 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582" returned: 0 in 0.367s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.remotefs [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-894dcfe0-5c10-4d51-b615-764966b5202b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88999) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcb366f-e6fe-4c79-97a7-0f0924eb2b32]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:10 devstack sudo[109787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b Aug 05 15:56:10 devstack sudo[109787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:10 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.259s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_service.periodic_task [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] Running periodic task VolumeManager._thread_info {{(pid=88999) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread count: 28 {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG cinder.volume.manager [None req-6204e4be-f6bb-4880-9663-6bca21536c7d None None] thread info: [<_MainThread(MainThread, started 131200944259200)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88999) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 05 15:56:10 devstack sudo[109787]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b" returned: 0 in 0.368s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:10 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 Aug 05 15:56:10 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:10 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582" returned: 0 in 0.359s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:10 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:11 devstack sudo[109800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582 Aug 05 15:56:11 devstack sudo[109800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:11 devstack sudo[109800]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:11 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b.b80243c0-f2dd-4bf5-a778-ea828326d582" returned: 0 in 0.243s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-b80243c0-f2dd-4bf5-a778-ea828326d582" released by "_delete_snapshot" :: held 1.434s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-894dcfe0-5c10-4d51-b615-764966b5202b" released by "delete_snapshot" :: held 1.456s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:11 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Created reservations ['0785509c-a17d-4ce0-9ec0-613e17cc2e97', 'e21b2516-39ce-4709-b769-e5b7078d909c', '632c8698-1314-466e-823e-1c60cbc1e2e6', 'f4d23739-782d-43dc-99d4-53b2c9096664'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:11 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Delete snapshot completed successfully. Aug 05 15:56:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-6006ff81-652b-4734-a592-3cc581afdadd tempest-ProjectMemberTests-514781381 None] Lock "cinder-b80243c0-f2dd-4bf5-a778-ea828326d582-delete_snapshot" released by "delete_snapshot" :: held 1.583s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:11 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-894dcfe0-5c10-4d51-b615-764966b5202b-delete_volume" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Lock "cinder-894dcfe0-5c10-4d51-b615-764966b5202b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Acquiring lock "cinder-quobyte-894dcfe0-5c10-4d51-b615-764966b5202b" by "delete_volume" {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-894dcfe0-5c10-4d51-b615-764966b5202b" acquired by "delete_volume" :: waited 0.018s {{(pid=88999) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bf5df5-75c7-4dcc-850b-819f19251a68]: (4, 'qcow2') {{(pid=90342) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:12 devstack sudo[109803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b Aug 05 15:56:12 devstack sudo[109803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:12 devstack sudo[109803]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b" returned: 0 in 0.395s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:12 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b Aug 05 15:56:12 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:12 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad/volume-894dcfe0-5c10-4d51-b615-764966b5202b" returned: 0 in 0.286s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Lock "cinder-quobyte-894dcfe0-5c10-4d51-b615-764966b5202b" released by "delete_volume" :: held 0.750s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.quota [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Created reservations ['b4e22ae8-9c2b-4101-ab57-de403237441a', '4aaef562-86d5-4311-8962-31d6a9b3c505', '38246f93-6e84-4781-8bf5-a8b23df4a50f', '5f75c3a1-a4cb-4dcd-b73f-d7a0aed542f3'] {{(pid=88999) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60': None} {{(pid=88999) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG cinder.volume.drivers.quobyte [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-54c25567-4f49-49ae-8800-d576dc604b60'] {{(pid=88999) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.lockutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88999) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 05 15:56:12 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 05 15:56:12 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad Aug 05 15:56:12 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 05 15:56:13 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Aug 05 15:56:13 devstack cinder-volume[88999]: DEBUG oslo_concurrency.processutils [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ee8c9746ff95b352acae806d9ed512ad" returned: 0 in 0.245s {{(pid=88999) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 05 15:56:13 devstack cinder-volume[88999]: DEBUG cinder.manager [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Notifying Schedulers of capabilities ... {{(pid=88999) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 05 15:56:13 devstack cinder-volume[88999]: INFO cinder.volume.manager [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Deleted volume successfully. Aug 05 15:56:13 devstack cinder-volume[88999]: DEBUG cinder.coordination [None req-0e5ccbfb-1191-4c24-9656-f31daf8b4303 tempest-ProjectMemberTests-514781381 None] Lock "cinder-894dcfe0-5c10-4d51-b615-764966b5202b-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=88999) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 05 15:56:22 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=63,cinder:UPDATE=81,cinder:INSERT=25,cinder:DELETE=6 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:56:23 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=106,cinder:SELECT=81,cinder:DELETE=12,cinder:INSERT=26 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:56:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:SELECT=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 05 15:56:41 devstack cinder-volume[88999]: DEBUG dbcounter [-] [88999] Writing DB stats cinder:UPDATE=1 {{(pid=88999) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}